-- Logs begin at Tue 2022-08-09 17:06:45 UTC, end at Tue 2022-08-09 18:49:13 UTC. -- Aug 09 18:06:55.666101 dv-cinder-797970-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 18:06:55.675392 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 18:06:55.677351 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 18:06:55 2022] *** Aug 09 18:06:55.677351 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 18:06:55.677351 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 18:06:55.677351 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: nodename: dv-cinder-797970-5-iscsi Aug 09 18:06:55.677351 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: machine: x86_64 Aug 09 18:06:55.677351 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: clock source: unix Aug 09 18:06:55.677351 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: pcre jit disabled Aug 09 18:06:55.677351 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: detected number of CPU cores: 4 Aug 09 18:06:55.677351 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: current working directory: / Aug 09 18:06:55.677351 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: detected binary path: /usr/bin/uwsgi-core Aug 09 18:06:55.678067 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: your processes number limit is 47680 Aug 09 18:06:55.678067 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: your memory page size is 4096 bytes Aug 09 18:06:55.678067 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: detected max file descriptor number: 2048 Aug 09 18:06:55.678067 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: lock engine: pthread robust mutexes Aug 09 18:06:55.678067 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: thunder lock: enabled Aug 09 18:06:55.678067 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 18:06:55.678067 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 18:06:55.715907 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: Python main interpreter initialized at 0x5621061919c0 Aug 09 18:06:55.715907 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: python threads support enabled Aug 09 18:06:55.715907 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: your server socket listen backlog is limited to 100 connections Aug 09 18:06:55.715907 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: your mercy for graceful operations on workers is 90 seconds Aug 09 18:06:55.716221 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 18:06:55.716307 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: *** Operational MODE: preforking *** Aug 09 18:06:55.716511 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: *** uWSGI is running in multiple interpreter mode *** Aug 09 18:06:55.716511 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: spawned uWSGI master process (pid: 103785) Aug 09 18:06:55.716702 dv-cinder-797970-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 09 18:06:55.718125 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: spawned uWSGI worker 1 (pid: 103786, cores: 1) Aug 09 18:06:55.718125 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: spawned uWSGI worker 2 (pid: 103787, cores: 1) Aug 09 18:06:55.718125 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 18:06:56.392842 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 18:06:56.397773 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 18:06:57.495765 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 18:06:57.495765 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: from cryptography.utils import int_from_bytes Aug 09 18:06:57.496397 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 18:06:57.496397 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: from cryptography.utils import int_from_bytes Aug 09 18:06:57.496696 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 18:06:57.496696 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: from cryptography.utils import int_from_bytes Aug 09 18:06:57.497131 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 18:06:57.497131 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: from cryptography.utils import int_from_bytes Aug 09 18:07:00.025681 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 18:07:00.026351 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 18:07:00.026452 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 18:07:00.026811 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 18:07:00.027063 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 18:07:00.027243 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 18:07:00.027612 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.027695 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 18:07:00.027781 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.028014 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 18:07:00.028117 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.028346 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.028440 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 18:07:00.028610 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 18:07:00.028709 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.028958 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.029043 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.029300 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.029401 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.029608 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.029701 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.029923 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.030017 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.030176 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.030284 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.030491 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.030595 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.030873 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797970-5-iscsi {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.031310 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.031383 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.031516 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.031658 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.031782 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.031903 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.032030 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.032158 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.032314 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.032448 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.032635 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797970-5-iscsi {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.032760 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.032959 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.033086 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.033269 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.033506 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.033662 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.034644 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.034801 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.034922 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.035055 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.035178 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.035308 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.035437 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.035560 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.035560 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.035803 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.035936 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.036056 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.036187 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.036315 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.036444 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.036573 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.036741 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.036871 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.036991 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.037122 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.037241 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797970-5-iscsi {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.037359 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.037476 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.037608 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.037718 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.037825 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.037949 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.038074 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.038256 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.038414 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.038572 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.038691 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797970-5-iscsi {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.038901 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.039014 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.039214 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.039313 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.039530 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.039628 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.039834 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.039952 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.040152 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.040245 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.040483 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.040583 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.040779 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.040877 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.041088 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.041180 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.041382 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.041469 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.041684 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.041778 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.041986 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.042072 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.042298 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.042385 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.042598 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.042691 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.042920 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.043007 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.043165 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.043261 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.043466 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.043551 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.043779 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.043865 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.044093 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.044187 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.044401 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.044485 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.044646 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.044740 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.044890 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.044979 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.045201 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.045287 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.045514 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.045675 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.045814 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.045997 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.046117 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.046247 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.046877 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.046988 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.047071 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.047156 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.047234 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.047335 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.047423 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.047525 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.047728 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.047821 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.048029 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.048124 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.048348 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.048472 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.048658 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.048755 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.048972 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.049084 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.049273 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.049368 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.049574 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.049671 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.049886 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.050010 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.050189 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.050293 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.050488 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.050584 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.050813 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.050922 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.051129 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.051217 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.051428 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.051518 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.051744 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.051885 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.052043 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.052174 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.052340 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.052464 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.052646 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.052772 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.052946 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.053070 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.053257 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.053384 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.053584 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.053718 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.053867 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.053992 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.054113 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.054232 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.054391 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.054525 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.054689 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.054873 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.055009 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.055232 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.055357 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.055483 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.055602 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.055720 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.055877 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.056009 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.056170 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.056295 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.056469 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.056600 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.056768 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.056899 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.057066 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.057188 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.057363 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.057487 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.057656 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.057786 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.057951 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.058073 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.058248 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.058369 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.058578 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.058726 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.058851 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.058981 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.059150 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.059282 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.059447 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.059576 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.059748 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.059872 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.060044 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.060175 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.060341 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.060464 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.060637 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.060767 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.060955 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.061070 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.061254 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.061349 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.061549 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.061643 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.061848 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.062627 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.062627 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.063220 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.063360 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.063482 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.063603 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.063731 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.063866 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.063994 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.064121 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.064243 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.064364 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.064493 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.064622 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.064743 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.064870 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.064991 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.065110 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.065231 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.065363 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.065491 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.065621 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.065742 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.065863 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.066038 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.066164 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.066341 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.066467 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.066652 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.066795 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.066981 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.067107 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.067283 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.067407 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.067575 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.067698 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.067873 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.067999 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.068175 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.068312 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.068474 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.068610 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.068808 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.068939 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.069062 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.069183 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.069334 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.069459 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.069645 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.069770 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.069963 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.070088 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.070267 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.070404 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.070568 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.070693 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.070888 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.071027 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.071217 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:07:00.071350 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.071510 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.071649 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.071836 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.071955 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.072142 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.072280 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.072463 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.072594 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.072770 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.072894 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.073083 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.073217 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.073388 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.073512 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.073700 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.073824 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.074006 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.074130 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.074327 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.074451 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.074633 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.074773 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.074965 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.075110 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.075271 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.075404 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.075572 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.075696 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.075881 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.076008 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.076203 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.076343 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.076514 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.076637 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.076816 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.076934 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.077127 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.077250 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.077434 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.077626 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.078791 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.078991 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.079119 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.079240 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.079375 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.079507 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.079637 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.079760 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.079889 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.080018 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.080140 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.080270 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.080391 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.080513 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.080640 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.080768 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.080932 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.081067 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.081244 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.081371 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.081554 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.081664 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.081858 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.081965 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.082179 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.082280 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.082470 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.082576 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.082797 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.082906 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.083116 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.083204 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.083426 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.083514 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.083735 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.083830 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.084040 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.084127 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.084349 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.084436 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.084653 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.084748 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.084958 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.085046 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.085264 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.085351 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.085564 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.085660 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.085862 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.085949 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.086159 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.086246 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.086461 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.086558 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.086781 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.086889 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.087089 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.087202 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.087389 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.087478 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.087689 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.087785 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.087990 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.088086 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.088312 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.088408 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.088596 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.088685 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.088899 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.088998 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.089206 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.089303 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.089504 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.089671 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.089810 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.089908 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.090117 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.090205 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.090418 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.090507 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.090736 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.090826 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.091050 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.091137 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.091348 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.091433 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.091654 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.091741 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.091955 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.092042 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.092255 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.092343 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.092565 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.092661 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.092871 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.092976 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.093194 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.093308 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.093567 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.093963 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.094069 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.094232 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.094321 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.094538 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.094627 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.094867 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.094958 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.095185 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.095272 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.095497 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.095586 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.095802 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.095895 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.096111 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.096198 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.096429 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.096516 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.096738 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.096866 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.097037 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.097148 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.097346 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.097445 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.097642 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.097729 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.097942 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.098039 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.098242 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.098333 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.098547 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.098635 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.098870 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.098972 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.099171 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.099260 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.099470 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.099558 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.099768 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.099866 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.100067 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.100164 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.100367 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.100454 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.100676 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.100772 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.100970 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.101056 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.101269 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.101356 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.101565 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.101660 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.101862 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.101959 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.102163 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.102252 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.102482 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.102574 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.102812 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.102915 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.103121 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.103208 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.103421 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.103524 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.103721 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.103816 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.104035 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.104122 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.104341 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.104469 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.104647 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.104736 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.104950 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.105048 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.105252 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.105340 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.105564 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.105659 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.105868 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.105964 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.106179 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.106266 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.106483 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.106577 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.106813 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.106916 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.107121 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.107217 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.107429 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.107527 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.107725 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.107825 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.108036 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.108121 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.108352 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.108441 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.108659 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.108750 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.109006 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.109197 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.109417 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.109524 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.109735 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.109908 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.110042 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.110222 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.110357 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.110531 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.110696 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.110864 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.111049 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.111172 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.111362 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.111480 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.111682 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.111778 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.111992 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.112088 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.112305 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.112412 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.112613 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.112710 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.112926 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.113014 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.113233 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.113334 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.113541 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.113636 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.113857 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.113943 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.114161 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.114255 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.114473 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.114561 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.114802 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.114896 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.115120 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.115224 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.115422 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.115510 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.115735 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.115828 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.116031 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.116127 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.116334 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.116420 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.116639 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.116729 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.116937 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.117026 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.117238 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.117328 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.117545 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.117645 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.117852 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.117942 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.118156 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.118244 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.118458 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.118559 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.118782 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.118873 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.119084 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.119171 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.119385 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.119471 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.119683 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.119775 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.119979 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.120067 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.120282 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.120378 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.120589 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.120677 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.120890 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.120977 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.121200 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.121294 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.121501 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.121587 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.121800 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.121888 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.122097 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.122192 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.122401 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.122488 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.122725 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.122815 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.123027 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.123124 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.123325 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.123413 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.123622 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.123708 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.123929 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.124024 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.124228 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.124319 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.125059 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.125161 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.125375 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.125464 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.125745 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.125832 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.126045 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.126140 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.126347 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.126444 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.126663 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.126822 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.126994 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.127082 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.127298 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.127385 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.127611 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.127726 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.127917 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.128028 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.128222 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.128316 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.128527 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.128648 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.128832 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.128936 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.129139 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.129231 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.129454 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.129546 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.129762 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.129921 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.130066 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.130155 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.130371 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.130464 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.130671 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.130824 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.131000 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.131089 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.131305 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.131392 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.131628 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.131866 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.131962 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.132195 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.132282 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.132504 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.132667 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.132816 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.132905 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.133125 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.133270 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.133437 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.133534 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.134027 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.134263 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.134352 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.134596 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.134685 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.134943 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.135053 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.135259 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.135347 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.135572 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.135658 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.135874 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.135972 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.136182 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.136270 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.136483 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.136570 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.136784 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.136880 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.137084 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.137181 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.137391 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.137494 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.137696 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.137807 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.137996 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.138095 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.138292 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.138388 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.138589 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.138692 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.138915 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.139012 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.139218 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.139368 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.139526 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.139681 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.139810 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.139983 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.140949 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.141057 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.141257 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.141382 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.141556 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.141746 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.141853 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.142108 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.142216 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.142437 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.142535 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.142778 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.142883 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.143120 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.143218 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.143444 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.143542 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.143772 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.143860 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.144070 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.144165 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.144371 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.144468 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.144690 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.144777 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.144987 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.145082 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.145286 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.145374 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.145583 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.145678 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.145886 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.145983 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.146189 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.146336 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.146484 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.146649 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.146810 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.146987 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.147114 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.147319 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.147406 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.147631 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.147732 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.147943 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.148053 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.148248 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.148347 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.148562 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.148664 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.148867 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.148955 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.149169 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.149264 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.149463 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.149558 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.149758 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.149847 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.150061 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.150149 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.150364 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.150453 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.150660 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.150778 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.150987 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.151086 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.151284 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.151373 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.151591 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.151678 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.151889 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.151984 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.152184 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.152285 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.152480 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.152569 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.152783 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.152872 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.153089 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.153185 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.153384 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.153471 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.153690 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.153786 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.153993 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.154087 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.154290 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.154379 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.154586 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.154682 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.154915 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.155003 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.155219 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.155355 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.155529 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.155626 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.155869 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.155978 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.156264 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.156372 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.156674 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.156774 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.156977 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.157066 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.157283 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.157373 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.157584 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.157770 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.157871 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.157968 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.158173 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.158286 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.158474 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.158571 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.158788 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.158891 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.159090 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.159179 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.159386 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.159475 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.159684 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.159779 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.159983 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.160112 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.160291 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.160405 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.160593 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.160681 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.160892 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.160993 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.161190 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.161279 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.161486 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.161574 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.161784 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.161880 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.162085 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.162173 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.162388 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.162484 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.162691 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.162805 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.163037 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.163125 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.163348 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.163473 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.163651 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.163752 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.163952 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.164038 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.164257 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.164350 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.164549 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.164645 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.164855 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.164942 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.165156 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.165246 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.165460 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.165558 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.165757 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.165845 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.166053 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.166142 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.166368 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.166456 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.166669 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.166815 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.166997 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.167098 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.167306 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.167394 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.167619 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.167744 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.167923 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.168010 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.168224 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.168342 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.168523 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.168624 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.168824 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.168934 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.169124 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.169220 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.169426 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.169522 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.169726 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.169841 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.170029 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.170140 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.170334 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.170439 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.170640 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.170764 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.170968 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.171055 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.171300 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.171438 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.171686 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.171794 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.171999 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.172093 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.172308 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.172396 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.172607 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.172694 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.172914 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.173010 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.173222 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.173309 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.173521 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.173610 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.173826 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.173920 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.174123 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.174211 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.174426 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.174515 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.174743 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.174836 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.175056 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.175174 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.175360 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.175471 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.175685 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.175772 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.175993 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.176090 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.176295 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.176383 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.176603 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.176691 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.176905 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.177002 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.177213 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.177308 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.177507 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.177593 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.177918 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.178022 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.178225 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.178329 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.178532 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.178630 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.178854 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.178957 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.179156 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.179248 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.179456 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.179543 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.179757 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.179846 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.180066 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.180153 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.180361 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.180495 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.180658 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.180773 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.180955 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.181089 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.181269 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.181399 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.181567 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.181705 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.181881 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.182006 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.182289 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.182386 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.182594 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.182685 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.182919 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.183008 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.183225 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.183323 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.183527 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.183615 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.183827 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.183923 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.184146 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.184242 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.184448 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.184543 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.184767 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.184855 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.185097 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.185192 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.185408 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.185497 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.185716 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.185811 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.186035 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.186207 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.186354 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.186442 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.186658 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.186810 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.187593 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.187698 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.187899 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.187997 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.188218 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.188307 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.188605 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.188707 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.188843 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.188932 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.189153 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.189275 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.189477 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.189574 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.189798 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.189895 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.190106 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.190200 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.190416 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.190524 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.190790 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.190900 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.191061 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.191158 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.191358 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.191445 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.191665 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.191761 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.191964 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.192060 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.192265 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.192392 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.192581 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.192711 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.192880 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.193019 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.193184 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.193336 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.193492 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.193657 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.193796 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.193961 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.194092 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.194262 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.194391 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.194571 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.194728 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.194901 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.195025 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.195204 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.195341 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.195525 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.195647 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.195829 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.195961 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.196139 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.196275 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.196446 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.196575 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.196752 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.196923 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.197054 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.197179 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.197354 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.197476 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.197674 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.197772 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.197976 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.198122 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.198296 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.198385 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.198605 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.198735 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.198952 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.199065 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.199268 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.199364 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.199572 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.199661 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.199891 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.199988 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.200198 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.200294 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.200499 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.200590 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.200800 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.200888 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.201102 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.201193 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.201418 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.201506 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.201737 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.201845 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.202054 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.202154 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.202380 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.202469 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.203232 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.203348 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.203650 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.203748 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.203973 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.204061 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.204283 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.204380 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.204582 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.204680 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.204882 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.204971 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.205180 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.205268 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.205501 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.205598 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.205802 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.205888 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.206106 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.206192 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.206408 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.206505 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.206731 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.206822 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.207026 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.207116 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.207327 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.207430 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.207650 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.207737 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.207952 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.208041 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.208252 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.208341 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.208566 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.208660 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.208867 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.208984 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.209188 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.209330 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.209489 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.209577 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.209789 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.209885 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.210091 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.210180 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.210392 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.210480 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.210697 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.210809 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.211026 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.211127 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.211330 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.211419 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.211639 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.211738 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.211946 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.212041 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.212257 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.212345 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.212590 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.212777 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.212906 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.213100 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.213222 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.213407 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.213539 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.213718 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.213851 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.214026 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.214163 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.214334 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.214472 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.214639 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.214810 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.214969 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.215123 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.215273 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.215439 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.215577 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.215881 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.215973 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.216202 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.216290 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.216516 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.216605 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.216834 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.216924 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.217166 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.217263 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.217480 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.217576 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.217791 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.217887 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.218101 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.218218 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.218429 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.218554 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.218760 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.218934 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.219074 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.219250 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.219401 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.219553 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.219719 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.219863 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.220044 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.220173 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.220375 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.220483 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.220690 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.220779 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.221003 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.221092 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.221315 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.221412 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.221631 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.221738 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.221961 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.222048 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.222264 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.222353 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.222570 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.222667 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.222902 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.222992 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.223215 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.223303 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.223528 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.223644 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.223838 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.223927 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.224143 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.224230 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.224450 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.224549 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.224758 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.224847 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.225065 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.225271 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.225368 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.225584 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.225673 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.225912 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.226000 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.226235 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.226402 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.226555 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.226643 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.226892 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.226982 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.227208 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.227298 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.227516 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.227604 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.227816 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.227909 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.228115 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.228333 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.228478 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.228650 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.228739 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.228982 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.229083 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.229315 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.229473 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.229607 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.229697 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.229904 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.230001 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.230216 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.230304 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.230519 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.230606 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.230854 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.231069 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.231161 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.231412 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.231513 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.231720 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.231819 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.232038 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.232126 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.232355 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.232441 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.232664 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.232765 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.232963 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.233050 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.233281 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.233369 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.233588 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.233689 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.234486 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.234648 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.234819 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.235022 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.235126 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.235338 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.235436 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.235665 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.235753 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.235990 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.236087 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.236293 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.236387 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.236593 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.236699 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.236898 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.236996 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.237195 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.237291 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.237496 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.237583 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.237799 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.237888 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.238097 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.238185 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.238395 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.238533 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.238695 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.238801 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.239015 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.239114 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.239313 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.239402 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.239612 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.239703 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.239908 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.239997 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.240206 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.240302 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.240503 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.240600 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.240807 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.240896 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.241105 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.241228 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.241406 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.241502 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.241705 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.241794 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.242007 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.242109 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.242305 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.242393 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.242606 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.242694 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.242931 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.243032 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.243238 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.243327 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.243541 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.243630 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.243852 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.243954 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.244154 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.244289 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.244461 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.244551 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.244761 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.244856 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.245065 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.245153 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.245367 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.245455 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.245686 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.245906 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.245996 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.246233 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.246330 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.246547 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.246644 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.246900 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.246991 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.247227 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.247316 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.247531 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.247672 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.247833 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.247933 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.248133 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.248222 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.248476 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.248572 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.248827 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.249003 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.249135 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.249335 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.250082 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.250231 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.250325 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.250627 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.250735 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.250968 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.251069 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.251275 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.251363 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.251581 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.251669 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.251885 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.251986 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.252185 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.252273 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.252488 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.252577 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.252793 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.252884 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.253097 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.253185 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.253398 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.253494 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.253705 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.253833 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.254014 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.254102 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.254323 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.254419 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.254630 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.254769 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.254965 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.255062 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.255271 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.255367 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.255575 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.255665 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.255880 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.255975 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.256184 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.256348 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.256487 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.256577 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.256794 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.256880 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.257116 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.257217 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.257423 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.257512 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.257723 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.257812 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.258034 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.258123 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.258348 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.258437 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.258927 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.259066 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.259252 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.259356 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.259561 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.259651 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.259869 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.259958 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.260184 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.260299 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.260513 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.260612 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.260824 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.260936 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.261127 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.261221 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.261449 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.261549 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.261780 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.261880 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.262099 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.262195 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.262419 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.262508 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.262734 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.262840 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.263040 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.263137 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.263341 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.263430 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.263664 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.263764 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.263968 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.264065 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.264281 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.264375 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.264606 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.264696 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.264920 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.265033 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.265324 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.265413 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.265636 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.265724 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.265938 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.266027 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.266236 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.266334 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.266534 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.266623 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.266859 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.266963 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.267162 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.267267 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.267460 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.267551 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.267757 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.267846 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.268056 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.268153 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.268353 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.268442 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.268650 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.268745 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.268949 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.269049 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.269245 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.269335 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.269543 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.269638 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.269837 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.269933 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.270133 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.270235 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.270432 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.270533 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.270745 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.270837 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.271051 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.271148 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.271352 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.271448 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.271652 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.271742 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.271964 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.272091 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.272263 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.272355 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.272565 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.272663 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.272866 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.272959 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.273164 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.273252 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.273464 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.273554 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.273769 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.273856 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.274101 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.274198 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.274409 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.274499 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.274743 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.274836 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.275041 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.275143 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.275347 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.275436 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.275654 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.275786 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.275956 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.276053 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.276275 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.276363 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.276582 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.276669 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.276883 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.276983 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.277200 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.277289 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.277506 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.277602 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.277814 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.277975 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.278122 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.278209 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.278426 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.278519 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.278750 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.278844 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.279059 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.279158 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.279365 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.279456 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.279692 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.279781 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.279996 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.280084 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.280317 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.280414 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.280646 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.280796 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.280975 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.281118 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.281283 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.281403 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.281591 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.281725 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.281921 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.282039 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.282229 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.282361 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.282536 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.282682 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.282868 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.283011 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.283177 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.283332 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.283485 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.283652 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.283797 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.283998 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.284096 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.284307 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.284403 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.284646 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.284734 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.284969 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.285131 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.285280 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.285378 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.285585 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.285674 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.285887 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.285984 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.286126 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 18:07:00.286216 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.286513 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.286882 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.287196 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.287537 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.287863 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.288176 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.288485 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.288788 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:07:00.289028 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 18:07:00.441056 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO dbcounter [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] Registered counter for database nova_api Aug 09 18:07:00.443338 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO dbcounter [None req-f2480aa8-4e27-4fd3-9055-7166e0350de3 None None] Registered counter for database nova_api Aug 09 18:07:00.462623 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_db.sqlalchemy.engines [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103786) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:07:00.466832 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG oslo_db.sqlalchemy.engines [None req-f2480aa8-4e27-4fd3-9055-7166e0350de3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:07:00.469549 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writer thread running {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:07:00.473528 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG dbcounter [-] [103787] Writer thread running {{(pid=103787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:07:00.525188 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.context [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87906804-98dc-4bc9-abd9-60a13ec853ee(cell1) {{(pid=103786) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 18:07:00.528966 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.context [None req-f2480aa8-4e27-4fd3-9055-7166e0350de3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87906804-98dc-4bc9-abd9-60a13ec853ee(cell1) {{(pid=103787) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 18:07:00.529106 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:00.529518 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:00.531156 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:00.531876 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:00.532320 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:00.533037 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG oslo_concurrency.lockutils [None req-f2480aa8-4e27-4fd3-9055-7166e0350de3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:00.533514 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG oslo_concurrency.lockutils [None req-f2480aa8-4e27-4fd3-9055-7166e0350de3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:00.534320 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:00.535081 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG oslo_concurrency.lockutils [None req-f2480aa8-4e27-4fd3-9055-7166e0350de3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:00.535811 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG oslo_concurrency.lockutils [None req-f2480aa8-4e27-4fd3-9055-7166e0350de3 None None] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:00.536253 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG oslo_concurrency.lockutils [None req-f2480aa8-4e27-4fd3-9055-7166e0350de3 None None] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:00.536343 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO dbcounter [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] Registered counter for database nova_cell0 Aug 09 18:07:00.538206 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG oslo_concurrency.lockutils [None req-f2480aa8-4e27-4fd3-9055-7166e0350de3 None None] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:00.540178 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO dbcounter [None req-f2480aa8-4e27-4fd3-9055-7166e0350de3 None None] Registered counter for database nova_cell0 Aug 09 18:07:00.541716 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO dbcounter [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] Registered counter for database nova_cell1 Aug 09 18:07:00.545475 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO dbcounter [None req-f2480aa8-4e27-4fd3-9055-7166e0350de3 None None] Registered counter for database nova_cell1 Aug 09 18:07:00.549940 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_db.sqlalchemy.engines [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103786) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:07:00.554979 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_db.sqlalchemy.engines [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103786) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:07:00.555128 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG oslo_db.sqlalchemy.engines [None req-f2480aa8-4e27-4fd3-9055-7166e0350de3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:07:00.556590 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG oslo_db.sqlalchemy.engines [None req-f2480aa8-4e27-4fd3-9055-7166e0350de3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:07:00.558497 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writer thread running {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:07:00.559002 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG dbcounter [-] [103787] Writer thread running {{(pid=103787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:07:00.559999 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writer thread running {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:07:00.697660 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG dbcounter [-] [103787] Writer thread running {{(pid=103787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:07:00.704421 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO dbcounter [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] Registered counter for database nova_cell0 Aug 09 18:07:00.706616 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO dbcounter [None req-f2480aa8-4e27-4fd3-9055-7166e0350de3 None None] Registered counter for database nova_cell0 Aug 09 18:07:00.713250 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_db.sqlalchemy.engines [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103786) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:07:00.715744 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG oslo_db.sqlalchemy.engines [None req-f2480aa8-4e27-4fd3-9055-7166e0350de3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:07:00.717603 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writer thread running {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:07:00.720963 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG dbcounter [-] [103787] Writer thread running {{(pid=103787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:07:01.171487 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: WARNING keystonemiddleware.auth_token [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 18:07:01.178790 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: WARNING keystonemiddleware.auth_token [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 18:07:01.191000 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: WARNING keystonemiddleware.auth_token [None req-f2480aa8-4e27-4fd3-9055-7166e0350de3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 18:07:01.198127 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: WARNING keystonemiddleware.auth_token [None req-f2480aa8-4e27-4fd3-9055-7166e0350de3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 18:07:01.521360 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: WARNING keystonemiddleware.auth_token [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 18:07:01.527355 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: WARNING keystonemiddleware.auth_token [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 18:07:01.533139 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5621061919c0 pid: 103786 (default app) Aug 09 18:07:01.535221 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:01.536399 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001749 Aug 09 18:07:01.536817 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Tue Aug 9 18:07:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:07:01.540011 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: WARNING keystonemiddleware.auth_token [None req-f2480aa8-4e27-4fd3-9055-7166e0350de3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 18:07:01.545919 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: WARNING keystonemiddleware.auth_token [None req-f2480aa8-4e27-4fd3-9055-7166e0350de3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 18:07:01.551971 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5621061919c0 pid: 103787 (default app) Aug 09 18:08:20.780094 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:20.784687 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001765 Aug 09 18:08:20.784687 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 2/2] 10.222.0.36 () {54 vars in 931 bytes} [Tue Aug 9 18:08:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:08:20.794640 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG dbcounter [-] [103787] Writing DB stats nova_api:SELECT=3 {{(pid=103787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:20.796617 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG dbcounter [-] [103787] Writing DB stats nova_cell1:SELECT=3 {{(pid=103787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:20.797835 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG dbcounter [-] [103787] Writing DB stats nova_cell0:SELECT=3 {{(pid=103787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:20.798925 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG dbcounter [-] [103787] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:21.689158 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-b8de9d60-3e07-48e2-ae15-f8198c891530 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:21.723088 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-b8de9d60-3e07-48e2-ae15-f8198c891530 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.933992 Aug 09 18:08:21.724025 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 1/3] 10.222.0.36 () {60 vars in 1292 bytes} [Tue Aug 9 18:08:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:23.986585 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:23.987914 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-1ab802c2-41df-4d0f-ac2c-a1fbb5f3161f None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001746 Aug 09 18:08:23.988489 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 3/4] 10.222.0.36 () {54 vars in 931 bytes} [Tue Aug 9 18:08:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:08:24.445869 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-80d605de-0dbc-48a0-a4d5-e8359c839b08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "cirros256", "disk": 1, "vcpus": 1, "id": "c1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 256}} {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:24.471208 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 18:08:24.471208 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: warnings.warn(msg) Aug 09 18:08:24.569516 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-80d605de-0dbc-48a0-a4d5-e8359c839b08 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.574847 Aug 09 18:08:24.570483 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 2/5] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Aug 9 18:08:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:08:24.790037 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-d626166c-4d25-4471-a4b2-6dfa59081319 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:24.794633 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 18:08:24.794633 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: warnings.warn(msg) Aug 09 18:08:24.797318 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writing DB stats nova_api:SELECT=3 {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:24.798181 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writing DB stats nova_cell1:SELECT=3 {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:24.799077 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writing DB stats nova_cell0:SELECT=3 {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:24.799791 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:24.944557 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-d626166c-4d25-4471-a4b2-6dfa59081319 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.364562 Aug 09 18:08:24.945350 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 4/6] 10.222.0.36 () {64 vars in 1336 bytes} [Tue Aug 9 18:08:24 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:27.179041 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-80d605de-0dbc-48a0-a4d5-e8359c839b08 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:27.180079 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-80d605de-0dbc-48a0-a4d5-e8359c839b08 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 09 18:08:27.180509 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 3/7] 10.222.0.36 () {54 vars in 931 bytes} [Tue Aug 9 18:08:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:08:27.843184 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-231028f7-e390-4399-939a-59a694df3824 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "ram": 512, "name": "ds512M", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "id": "d1"}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:27.861793 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 18:08:27.861793 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: warnings.warn(msg) Aug 09 18:08:27.971802 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-231028f7-e390-4399-939a-59a694df3824 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.784904 Aug 09 18:08:27.972658 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 5/8] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Aug 9 18:08:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:08:27.985847 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-f96d8621-9b4d-4281-8819-3a2ee629418b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:27.989169 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 18:08:27.989169 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: warnings.warn(msg) Aug 09 18:08:28.097993 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-f96d8621-9b4d-4281-8819-3a2ee629418b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115838 Aug 09 18:08:28.105471 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 4/9] 10.222.0.36 () {64 vars in 1336 bytes} [Tue Aug 9 18:08:27 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:30.362766 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-231028f7-e390-4399-939a-59a694df3824 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:30.364523 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-231028f7-e390-4399-939a-59a694df3824 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002263 Aug 09 18:08:30.365001 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 6/10] 10.222.0.36 () {54 vars in 931 bytes} [Tue Aug 9 18:08:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:08:30.766393 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-6dad072d-912f-49e9-a8db-80f3eb031659 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 1024, "name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:30.850978 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-6dad072d-912f-49e9-a8db-80f3eb031659 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.479511 Aug 09 18:08:30.859009 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 5/11] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Aug 9 18:08:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:08:30.864077 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-27708dfb-ba9e-47ee-8533-be15def729a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:30.954010 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-27708dfb-ba9e-47ee-8533-be15def729a6 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093542 Aug 09 18:08:30.966744 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 7/12] 10.222.0.36 () {64 vars in 1336 bytes} [Tue Aug 9 18:08:30 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:33.195105 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-6dad072d-912f-49e9-a8db-80f3eb031659 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:33.196133 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-6dad072d-912f-49e9-a8db-80f3eb031659 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Aug 09 18:08:33.196625 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 6/13] 10.222.0.36 () {54 vars in 931 bytes} [Tue Aug 9 18:08:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:08:33.664605 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-7437f4f9-1f00-4c3e-bab6-868e53f10352 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 2048, "os-flavor-access:is_public": true, "id": "d3", "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:33.748995 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-7437f4f9-1f00-4c3e-bab6-868e53f10352 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.546014 Aug 09 18:08:33.749650 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 8/14] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Aug 9 18:08:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:08:33.763024 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-a5a85939-ed0a-487e-9d10-98c3731d509c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:33.856253 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-a5a85939-ed0a-487e-9d10-98c3731d509c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097998 Aug 09 18:08:33.856923 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 7/15] 10.222.0.36 () {64 vars in 1336 bytes} [Tue Aug 9 18:08:33 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:36.088457 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-7437f4f9-1f00-4c3e-bab6-868e53f10352 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:36.090216 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-7437f4f9-1f00-4c3e-bab6-868e53f10352 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002168 Aug 09 18:08:36.090612 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 9/16] 10.222.0.36 () {54 vars in 931 bytes} [Tue Aug 9 18:08:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:08:36.520091 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-c9381e55-9c5b-4bd5-a170-3c563166321c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 20, "ram": 4096, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:36.594489 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-c9381e55-9c5b-4bd5-a170-3c563166321c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.497317 Aug 09 18:08:36.595281 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 8/17] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Aug 9 18:08:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:08:36.609039 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-5b855194-adfd-4408-a45f-161ca8dc53a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:36.691107 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-5b855194-adfd-4408-a45f-161ca8dc53a0 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086361 Aug 09 18:08:36.691759 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 10/18] 10.222.0.36 () {64 vars in 1336 bytes} [Tue Aug 9 18:08:36 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:39.126824 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-c9381e55-9c5b-4bd5-a170-3c563166321c admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:39.127843 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-c9381e55-9c5b-4bd5-a170-3c563166321c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Aug 09 18:08:39.128243 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 9/19] 10.222.0.36 () {54 vars in 931 bytes} [Tue Aug 9 18:08:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:08:39.569042 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-b88a3c9a-5d7a-41e9-870a-56914d1c750d admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:39.596109 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-b88a3c9a-5d7a-41e9-870a-56914d1c750d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.461420 Aug 09 18:08:39.596672 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 11/20] 10.222.0.36 () {60 vars in 1292 bytes} [Tue Aug 9 18:08:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:08:41.909614 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-c9381e55-9c5b-4bd5-a170-3c563166321c admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:41.910689 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-c9381e55-9c5b-4bd5-a170-3c563166321c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Aug 09 18:08:41.911157 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 10/21] 10.222.0.36 () {54 vars in 931 bytes} [Tue Aug 9 18:08:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:08:42.340428 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-9f977811-359f-4b07-aca7-02fe2d369f35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:42.417539 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-9f977811-359f-4b07-aca7-02fe2d369f35 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.499547 Aug 09 18:08:42.418129 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 12/22] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Aug 9 18:08:41 2022] POST /compute/v2.1/flavors => generated 402 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:08:42.430669 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-0af49484-f87b-4d90-91e4-762d5f32d423 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:42.520292 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-0af49484-f87b-4d90-91e4-762d5f32d423 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093266 Aug 09 18:08:42.520813 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 11/23] 10.222.0.36 () {64 vars in 1333 bytes} [Tue Aug 9 18:08:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:44.758207 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-9f977811-359f-4b07-aca7-02fe2d369f35 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:44.759257 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-9f977811-359f-4b07-aca7-02fe2d369f35 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 09 18:08:44.759660 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 931 bytes} [Tue Aug 9 18:08:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:08:45.154508 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-a159fad7-4aa5-4b2d-bf0f-40fd43061e0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "id": "2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:45.230134 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-a159fad7-4aa5-4b2d-bf0f-40fd43061e0e admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.463907 Aug 09 18:08:45.230696 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 12/25] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Aug 9 18:08:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:08:45.242592 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-71ba15b2-e2d5-4734-bbe0-437fa1da857a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:45.325067 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-71ba15b2-e2d5-4734-bbe0-437fa1da857a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086008 Aug 09 18:08:45.325700 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 14/26] 10.222.0.36 () {64 vars in 1333 bytes} [Tue Aug 9 18:08:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:47.548405 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-a159fad7-4aa5-4b2d-bf0f-40fd43061e0e admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:47.549725 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-a159fad7-4aa5-4b2d-bf0f-40fd43061e0e admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001890 Aug 09 18:08:47.550189 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 13/27] 10.222.0.36 () {54 vars in 931 bytes} [Tue Aug 9 18:08:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:08:47.958301 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-9b715287-9298-4c04-b957-8fd74c1b919a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "id": "3", "name": "m1.medium", "vcpus": 2}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:48.052120 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-9b715287-9298-4c04-b957-8fd74c1b919a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.495054 Aug 09 18:08:48.052678 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 15/28] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Aug 9 18:08:47 2022] POST /compute/v2.1/flavors => generated 406 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:08:48.066539 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-fb89479a-bbb3-4f3b-ab49-a3aefcdc2c31 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:48.146570 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-fb89479a-bbb3-4f3b-ab49-a3aefcdc2c31 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083651 Aug 09 18:08:48.147074 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 14/29] 10.222.0.36 () {64 vars in 1333 bytes} [Tue Aug 9 18:08:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:50.468593 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-9b715287-9298-4c04-b957-8fd74c1b919a admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:50.469602 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-9b715287-9298-4c04-b957-8fd74c1b919a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 09 18:08:50.470011 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 16/30] 10.222.0.36 () {54 vars in 931 bytes} [Tue Aug 9 18:08:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:08:51.090406 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-11c65617-d3c5-4fb5-b7ea-5cb0605d6a15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192, "id": "4"}} {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:51.097060 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG dbcounter [-] [103787] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:51.303980 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-11c65617-d3c5-4fb5-b7ea-5cb0605d6a15 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.827354 Aug 09 18:08:51.304529 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 15/31] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Aug 9 18:08:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:08:51.317984 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-e64fabce-1d28-457f-a62a-8af8aae70cd0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:51.467880 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-e64fabce-1d28-457f-a62a-8af8aae70cd0 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.153659 Aug 09 18:08:51.468782 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 17/32] 10.222.0.36 () {64 vars in 1333 bytes} [Tue Aug 9 18:08:51 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:53.727992 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-11c65617-d3c5-4fb5-b7ea-5cb0605d6a15 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:53.729008 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-11c65617-d3c5-4fb5-b7ea-5cb0605d6a15 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001679 Aug 09 18:08:53.729407 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 16/33] 10.222.0.36 () {54 vars in 931 bytes} [Tue Aug 9 18:08:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:08:54.184984 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-9fdd3f21-50b5-4b46-bc7c-544873a924a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "rxtx_factor": 1.0, "ram": 16384, "swap": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:54.276566 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-9fdd3f21-50b5-4b46-bc7c-544873a924a0 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.540322 Aug 09 18:08:54.277062 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 18/34] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Aug 9 18:08:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:08:54.291650 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-9e1d55f9-fbdc-4191-ab44-33de93fbd363 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:54.377163 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-9e1d55f9-fbdc-4191-ab44-33de93fbd363 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090659 Aug 09 18:08:54.378083 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 17/35] 10.222.0.36 () {64 vars in 1333 bytes} [Tue Aug 9 18:08:54 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:09:14.941529 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-9fdd3f21-50b5-4b46-bc7c-544873a924a0 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:14.942560 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-9fdd3f21-50b5-4b46-bc7c-544873a924a0 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 09 18:09:14.942982 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 19/36] 10.222.0.36 () {54 vars in 931 bytes} [Tue Aug 9 18:09:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:09:15.329948 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-0f5f08e1-6d33-4d86-8d36-9f1929c80307 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:15.348113 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-0f5f08e1-6d33-4d86-8d36-9f1929c80307 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398369 Aug 09 18:09:15.348638 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 18/37] 10.222.0.36 () {60 vars in 1292 bytes} [Tue Aug 9 18:09:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:09:16.411923 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-9fdd3f21-50b5-4b46-bc7c-544873a924a0 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:16.413605 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-9fdd3f21-50b5-4b46-bc7c-544873a924a0 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001976 Aug 09 18:09:16.414031 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 20/38] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Aug 9 18:09:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:09:16.939151 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-09db491d-38ab-4868-ad26-bd1c66b13f55 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:16.944721 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.wsgi [None req-09db491d-38ab-4868-ad26-bd1c66b13f55 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 18:09:16.949266 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-09db491d-38ab-4868-ad26-bd1c66b13f55 admin admin] Request method failure captured: Aug 09 18:09:16.949266 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 18:09:16.949266 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: Accept: application/json Aug 09 18:09:16.949266 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: Accept-Encoding: gzip, deflate Aug 09 18:09:16.949266 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: Connection: keep-alive Aug 09 18:09:16.949266 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: Content-Length: 0 Aug 09 18:09:16.949266 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: Host: 10.222.0.36 Aug 09 18:09:16.949266 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: Openstack-Api-Version: compute 2.90 Aug 09 18:09:16.949266 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: Openstack-System-Scope: None Aug 09 18:09:16.949266 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: User-Agent: python-novaclient Aug 09 18:09:16.949266 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Auth-Token: gAAAAABi8qLMBadvCEfkHLfhMLakpLPt86ZNVgQpjpHaiu0F_6efqP1YBcrj00snTnc9Wla7c5Eof3lngn_fkuXEAHtAUAoYg1hV6SB2Ujy7zGYxEFX8ASJ4iXe3P3uYK1qwPNGNhCoc9tSD1S2o4UKyHrA4ncSXEGmIxva5BcV1qczY_dN8P3o Aug 09 18:09:16.949266 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Domain-Id: None Aug 09 18:09:16.949266 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Domain-Name: None Aug 09 18:09:16.949266 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Identity-Status: Confirmed Aug 09 18:09:16.949266 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Is-Admin-Project: True Aug 09 18:09:16.949266 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 18:09:16.949266 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Project-Domain-Id: default Aug 09 18:09:16.949266 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Project-Domain-Name: Default Aug 09 18:09:16.949266 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Project-Id: c024e80f00ae4274ad841a20660b3ad2 Aug 09 18:09:16.949266 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Project-Name: admin Aug 09 18:09:16.949266 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Role: admin,reader,member Aug 09 18:09:16.949266 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Roles: admin,reader,member Aug 09 18:09:16.951184 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c024e80f00ae4274ad841a20660b3ad2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c024e80f00ae4274ad841a20660b3ad2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c024e80f00ae4274ad841a20660b3ad2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c024e80f00ae4274ad841a20660b3ad2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:09:16.951184 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Tenant: admin Aug 09 18:09:16.951184 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Tenant-Id: c024e80f00ae4274ad841a20660b3ad2 Aug 09 18:09:16.951184 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Tenant-Name: admin Aug 09 18:09:16.951184 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-User: admin Aug 09 18:09:16.951184 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-User-Domain-Id: default Aug 09 18:09:16.951184 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-User-Domain-Name: Default Aug 09 18:09:16.951184 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-User-Id: c800e45fdce14a59ae5bf0f84f3671cd Aug 09 18:09:16.951184 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-User-Name: admin Aug 09 18:09:16.951184 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: method: > Aug 09 18:09:16.951184 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: exception: Flavor 42 could not be found. Aug 09 18:09:16.951184 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: action_args: {'id': '42'} Aug 09 18:09:16.951184 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:09:16.951184 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:16.952287 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 18:09:16.952287 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 18:09:16.952287 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 18:09:16.952287 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 18:09:16.952287 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:09:16.952287 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:09:16.952287 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 18:09:16.952287 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 18:09:16.952287 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 18:09:16.952287 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:09:16.952287 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 18:09:16.952287 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 18:09:16.952287 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 18:09:16.952287 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Aug 09 18:09:16.952287 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:09:16.952287 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Aug 09 18:09:16.952287 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:16.952287 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:09:16.952287 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:09:16.953462 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:09:16.953462 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:09:16.953462 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:09:16.953462 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:09:16.953462 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 18:09:16.953462 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:09:16.953462 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 18:09:16.953462 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Aug 09 18:09:16.953462 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:09:16.953462 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Aug 09 18:09:16.953462 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:16.953462 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:09:16.953462 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:09:16.953462 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:09:16.953462 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:09:16.953462 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 18:09:16.953462 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Aug 09 18:09:16.953462 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-09db491d-38ab-4868-ad26-bd1c66b13f55 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:09:16.954745 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-09db491d-38ab-4868-ad26-bd1c66b13f55 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.396526 Aug 09 18:09:16.954745 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 19/39] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Aug 9 18:09:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 18:09:16.960330 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-e66d5edc-7f02-4934-a21b-7a9b429e3f61 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:16.964992 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:09:16.983013 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-e66d5edc-7f02-4934-a21b-7a9b429e3f61 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026157 Aug 09 18:09:16.983550 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 21/40] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Aug 9 18:09:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:09:16.993067 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-74522c01-8ef2-48a7-8c11-247cac4654a3 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:17.017584 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-74522c01-8ef2-48a7-8c11-247cac4654a3 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027996 Aug 09 18:09:17.018115 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 20/41] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Aug 9 18:09:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:09:17.028535 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-b8434716-5252-41bc-ba40-50f10db55186 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:17.034176 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.wsgi [None req-b8434716-5252-41bc-ba40-50f10db55186 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 18:09:17.037442 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-b8434716-5252-41bc-ba40-50f10db55186 admin admin] Request method failure captured: Aug 09 18:09:17.037442 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 18:09:17.037442 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: Accept: application/json Aug 09 18:09:17.037442 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: Accept-Encoding: gzip, deflate Aug 09 18:09:17.037442 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: Connection: keep-alive Aug 09 18:09:17.037442 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: Content-Length: 0 Aug 09 18:09:17.037442 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: Host: 10.222.0.36 Aug 09 18:09:17.037442 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: Openstack-Api-Version: compute 2.90 Aug 09 18:09:17.037442 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: Openstack-System-Scope: None Aug 09 18:09:17.037442 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: User-Agent: python-novaclient Aug 09 18:09:17.037442 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Auth-Token: gAAAAABi8qLMBadvCEfkHLfhMLakpLPt86ZNVgQpjpHaiu0F_6efqP1YBcrj00snTnc9Wla7c5Eof3lngn_fkuXEAHtAUAoYg1hV6SB2Ujy7zGYxEFX8ASJ4iXe3P3uYK1qwPNGNhCoc9tSD1S2o4UKyHrA4ncSXEGmIxva5BcV1qczY_dN8P3o Aug 09 18:09:17.037442 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Domain-Id: None Aug 09 18:09:17.037442 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Domain-Name: None Aug 09 18:09:17.037442 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Identity-Status: Confirmed Aug 09 18:09:17.037442 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Is-Admin-Project: True Aug 09 18:09:17.037442 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 18:09:17.037442 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Project-Domain-Id: default Aug 09 18:09:17.037442 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Project-Domain-Name: Default Aug 09 18:09:17.037442 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Project-Id: c024e80f00ae4274ad841a20660b3ad2 Aug 09 18:09:17.037442 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Project-Name: admin Aug 09 18:09:17.037442 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Role: admin,reader,member Aug 09 18:09:17.037442 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Roles: admin,reader,member Aug 09 18:09:17.043033 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c024e80f00ae4274ad841a20660b3ad2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c024e80f00ae4274ad841a20660b3ad2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c024e80f00ae4274ad841a20660b3ad2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c024e80f00ae4274ad841a20660b3ad2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:09:17.043033 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Tenant: admin Aug 09 18:09:17.043033 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Tenant-Id: c024e80f00ae4274ad841a20660b3ad2 Aug 09 18:09:17.043033 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Tenant-Name: admin Aug 09 18:09:17.043033 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-User: admin Aug 09 18:09:17.043033 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-User-Domain-Id: default Aug 09 18:09:17.043033 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-User-Domain-Name: Default Aug 09 18:09:17.043033 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-User-Id: c800e45fdce14a59ae5bf0f84f3671cd Aug 09 18:09:17.043033 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-User-Name: admin Aug 09 18:09:17.043033 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: method: > Aug 09 18:09:17.043033 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: exception: Flavor 42 could not be found. Aug 09 18:09:17.043033 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: action_args: {'id': '42'} Aug 09 18:09:17.043033 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:09:17.043033 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:17.043845 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 18:09:17.043845 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 18:09:17.043845 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 18:09:17.043845 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 18:09:17.043845 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:09:17.043845 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:09:17.043845 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 18:09:17.043845 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 18:09:17.043845 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 18:09:17.043845 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:09:17.043845 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 18:09:17.043845 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 18:09:17.043845 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 18:09:17.043845 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Aug 09 18:09:17.043845 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:09:17.043845 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Aug 09 18:09:17.043845 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:17.043845 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:09:17.043845 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:09:17.045017 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:09:17.045017 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:09:17.045017 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:09:17.045017 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:09:17.045017 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 18:09:17.045017 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:09:17.045017 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 18:09:17.045017 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Aug 09 18:09:17.045017 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:09:17.045017 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Aug 09 18:09:17.045017 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:17.045017 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:09:17.045017 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:09:17.045017 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:09:17.045017 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:09:17.045017 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 18:09:17.045017 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Aug 09 18:09:17.045017 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-b8434716-5252-41bc-ba40-50f10db55186 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:09:17.046223 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-b8434716-5252-41bc-ba40-50f10db55186 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014943 Aug 09 18:09:17.046223 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 22/42] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Aug 9 18:09:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 18:09:18.009575 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-74522c01-8ef2-48a7-8c11-247cac4654a3 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:18.010572 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-74522c01-8ef2-48a7-8c11-247cac4654a3 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 09 18:09:18.010994 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 21/43] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Aug 9 18:09:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:09:18.530475 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-b3701fc6-262b-4b65-abe8-7e900c6bc5a3 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:18.535850 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.wsgi [None req-b3701fc6-262b-4b65-abe8-7e900c6bc5a3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 18:09:18.537340 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-b3701fc6-262b-4b65-abe8-7e900c6bc5a3 admin admin] Request method failure captured: Aug 09 18:09:18.537340 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 18:09:18.537340 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: Accept: application/json Aug 09 18:09:18.537340 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: Accept-Encoding: gzip, deflate Aug 09 18:09:18.537340 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: Connection: keep-alive Aug 09 18:09:18.537340 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: Content-Length: 0 Aug 09 18:09:18.537340 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: Host: 10.222.0.36 Aug 09 18:09:18.537340 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: Openstack-Api-Version: compute 2.90 Aug 09 18:09:18.537340 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: Openstack-System-Scope: None Aug 09 18:09:18.537340 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: User-Agent: python-novaclient Aug 09 18:09:18.537340 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Auth-Token: gAAAAABi8qLNVCmMMgtDPbC__oqPNagExZgvG8Ehh0_fesOSvVXxrQ4zDY_o7H_rXu9ohww2FCXgJrZSpKa7LKis9hUMvRvvfSlJloFq-v7KzswnaD8prPw_4BGvHCXjwBgznIWtmEHvJ5tiDDzE-cK4RZXLzUNm-St-xwTbzhVuIe58O5lFgYw Aug 09 18:09:18.537340 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Domain-Id: None Aug 09 18:09:18.537340 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Domain-Name: None Aug 09 18:09:18.537340 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Identity-Status: Confirmed Aug 09 18:09:18.537340 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Is-Admin-Project: True Aug 09 18:09:18.537340 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 18:09:18.537340 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Project-Domain-Id: default Aug 09 18:09:18.537340 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Project-Domain-Name: Default Aug 09 18:09:18.537340 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Project-Id: c024e80f00ae4274ad841a20660b3ad2 Aug 09 18:09:18.537340 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Project-Name: admin Aug 09 18:09:18.537340 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Role: admin,reader,member Aug 09 18:09:18.537340 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Roles: admin,reader,member Aug 09 18:09:18.538949 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c024e80f00ae4274ad841a20660b3ad2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c024e80f00ae4274ad841a20660b3ad2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c024e80f00ae4274ad841a20660b3ad2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c024e80f00ae4274ad841a20660b3ad2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:09:18.538949 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Tenant: admin Aug 09 18:09:18.538949 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Tenant-Id: c024e80f00ae4274ad841a20660b3ad2 Aug 09 18:09:18.538949 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Tenant-Name: admin Aug 09 18:09:18.538949 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-User: admin Aug 09 18:09:18.538949 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-User-Domain-Id: default Aug 09 18:09:18.538949 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-User-Domain-Name: Default Aug 09 18:09:18.538949 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-User-Id: c800e45fdce14a59ae5bf0f84f3671cd Aug 09 18:09:18.538949 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-User-Name: admin Aug 09 18:09:18.538949 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: method: > Aug 09 18:09:18.538949 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: exception: Flavor 84 could not be found. Aug 09 18:09:18.538949 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: action_args: {'id': '84'} Aug 09 18:09:18.538949 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:09:18.538949 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:18.539804 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 18:09:18.539804 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 18:09:18.539804 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 18:09:18.539804 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 18:09:18.539804 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:09:18.539804 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:09:18.539804 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 18:09:18.539804 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 18:09:18.539804 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 18:09:18.539804 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:09:18.539804 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 18:09:18.539804 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 18:09:18.539804 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 18:09:18.539804 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Aug 09 18:09:18.539804 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:09:18.539804 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Aug 09 18:09:18.539804 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:18.539804 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:09:18.539804 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:09:18.541286 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:09:18.541286 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:09:18.541286 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:09:18.541286 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:09:18.541286 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 18:09:18.541286 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:09:18.541286 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 18:09:18.541286 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Aug 09 18:09:18.541286 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:09:18.541286 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Aug 09 18:09:18.541286 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:18.541286 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:09:18.541286 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:09:18.541286 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:09:18.541286 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:09:18.541286 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 18:09:18.541286 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Aug 09 18:09:18.541286 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-b3701fc6-262b-4b65-abe8-7e900c6bc5a3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:09:18.542591 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-b3701fc6-262b-4b65-abe8-7e900c6bc5a3 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.390445 Aug 09 18:09:18.542591 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 23/44] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Aug 9 18:09:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 18:09:18.548706 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-01ccbb66-df87-4001-8e0f-3b75db106410 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:18.563614 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-01ccbb66-df87-4001-8e0f-3b75db106410 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018440 Aug 09 18:09:18.564138 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 22/45] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Aug 9 18:09:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:09:18.573982 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-e7feae60-b5e3-4aee-a52d-fee1afdf953d admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:18.591287 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-e7feae60-b5e3-4aee-a52d-fee1afdf953d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021271 Aug 09 18:09:18.591814 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Aug 9 18:09:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:09:18.600978 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-42fddedf-627f-4b5b-9757-f877f6251794 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:18.606594 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.wsgi [None req-42fddedf-627f-4b5b-9757-f877f6251794 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 18:09:18.608114 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-42fddedf-627f-4b5b-9757-f877f6251794 admin admin] Request method failure captured: Aug 09 18:09:18.608114 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 18:09:18.608114 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: Accept: application/json Aug 09 18:09:18.608114 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: Accept-Encoding: gzip, deflate Aug 09 18:09:18.608114 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: Connection: keep-alive Aug 09 18:09:18.608114 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: Content-Length: 0 Aug 09 18:09:18.608114 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: Host: 10.222.0.36 Aug 09 18:09:18.608114 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: Openstack-Api-Version: compute 2.90 Aug 09 18:09:18.608114 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: Openstack-System-Scope: None Aug 09 18:09:18.608114 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: User-Agent: python-novaclient Aug 09 18:09:18.608114 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Auth-Token: gAAAAABi8qLNVCmMMgtDPbC__oqPNagExZgvG8Ehh0_fesOSvVXxrQ4zDY_o7H_rXu9ohww2FCXgJrZSpKa7LKis9hUMvRvvfSlJloFq-v7KzswnaD8prPw_4BGvHCXjwBgznIWtmEHvJ5tiDDzE-cK4RZXLzUNm-St-xwTbzhVuIe58O5lFgYw Aug 09 18:09:18.608114 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Domain-Id: None Aug 09 18:09:18.608114 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Domain-Name: None Aug 09 18:09:18.608114 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Identity-Status: Confirmed Aug 09 18:09:18.608114 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Is-Admin-Project: True Aug 09 18:09:18.608114 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 18:09:18.608114 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Project-Domain-Id: default Aug 09 18:09:18.608114 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Project-Domain-Name: Default Aug 09 18:09:18.608114 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Project-Id: c024e80f00ae4274ad841a20660b3ad2 Aug 09 18:09:18.608114 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Project-Name: admin Aug 09 18:09:18.608114 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Role: admin,reader,member Aug 09 18:09:18.608114 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Roles: admin,reader,member Aug 09 18:09:18.609605 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c024e80f00ae4274ad841a20660b3ad2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c024e80f00ae4274ad841a20660b3ad2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c024e80f00ae4274ad841a20660b3ad2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c024e80f00ae4274ad841a20660b3ad2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:09:18.609605 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Tenant: admin Aug 09 18:09:18.609605 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Tenant-Id: c024e80f00ae4274ad841a20660b3ad2 Aug 09 18:09:18.609605 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Tenant-Name: admin Aug 09 18:09:18.609605 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-User: admin Aug 09 18:09:18.609605 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-User-Domain-Id: default Aug 09 18:09:18.609605 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-User-Domain-Name: Default Aug 09 18:09:18.609605 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-User-Id: c800e45fdce14a59ae5bf0f84f3671cd Aug 09 18:09:18.609605 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-User-Name: admin Aug 09 18:09:18.609605 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: method: > Aug 09 18:09:18.609605 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: exception: Flavor 84 could not be found. Aug 09 18:09:18.609605 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: action_args: {'id': '84'} Aug 09 18:09:18.609605 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:09:18.609605 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:18.610443 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 18:09:18.610443 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 18:09:18.610443 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 18:09:18.610443 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 18:09:18.610443 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:09:18.610443 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:09:18.610443 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 18:09:18.610443 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 18:09:18.610443 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 18:09:18.610443 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:09:18.610443 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 18:09:18.610443 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 18:09:18.610443 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 18:09:18.610443 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Aug 09 18:09:18.610443 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:09:18.610443 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Aug 09 18:09:18.610443 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:18.610443 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:09:18.610443 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:09:18.611702 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:09:18.611702 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:09:18.611702 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:09:18.611702 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:09:18.611702 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 18:09:18.611702 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:09:18.611702 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 18:09:18.611702 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Aug 09 18:09:18.611702 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:09:18.611702 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Aug 09 18:09:18.611702 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:18.611702 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:09:18.611702 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:09:18.611702 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:09:18.611702 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:09:18.611702 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 18:09:18.611702 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Aug 09 18:09:18.611702 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-42fddedf-627f-4b5b-9757-f877f6251794 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:09:18.612716 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-42fddedf-627f-4b5b-9757-f877f6251794 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012032 Aug 09 18:09:18.612716 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 23/47] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Aug 9 18:09:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 18:09:19.579344 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-e7feae60-b5e3-4aee-a52d-fee1afdf953d admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:19.580348 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-e7feae60-b5e3-4aee-a52d-fee1afdf953d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 09 18:09:19.580859 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 25/48] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Aug 9 18:09:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:09:20.103894 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-99699935-cc2d-4898-9230-84a93c6920c0 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:20.109607 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.wsgi [None req-99699935-cc2d-4898-9230-84a93c6920c0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 18:09:20.111167 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-99699935-cc2d-4898-9230-84a93c6920c0 admin admin] Request method failure captured: Aug 09 18:09:20.111167 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 18:09:20.111167 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: Accept: application/json Aug 09 18:09:20.111167 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: Accept-Encoding: gzip, deflate Aug 09 18:09:20.111167 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: Connection: keep-alive Aug 09 18:09:20.111167 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: Content-Length: 0 Aug 09 18:09:20.111167 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: Host: 10.222.0.36 Aug 09 18:09:20.111167 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: Openstack-Api-Version: compute 2.90 Aug 09 18:09:20.111167 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: Openstack-System-Scope: None Aug 09 18:09:20.111167 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: User-Agent: python-novaclient Aug 09 18:09:20.111167 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Auth-Token: gAAAAABi8qLP2T0YcgoQMqfzV_R_WnsYUdvZTMvn0mFscwrQcdB_4fReTOWuQP6sxbMZh44aze1wPh2g5Pjl6DbZcLa2fvZx3xUDLjBiqMar-_qDdYL5irL4hizC41HPG62p-W9bvAX51pJ-UZOKHdFKbkFwRL7iLhLu-M-l8xzigYc7zyoq8zw Aug 09 18:09:20.111167 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Domain-Id: None Aug 09 18:09:20.111167 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Domain-Name: None Aug 09 18:09:20.111167 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Identity-Status: Confirmed Aug 09 18:09:20.111167 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Is-Admin-Project: True Aug 09 18:09:20.111167 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 18:09:20.111167 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Project-Domain-Id: default Aug 09 18:09:20.111167 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Project-Domain-Name: Default Aug 09 18:09:20.111167 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Project-Id: c024e80f00ae4274ad841a20660b3ad2 Aug 09 18:09:20.111167 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Project-Name: admin Aug 09 18:09:20.111167 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Role: admin,reader,member Aug 09 18:09:20.111167 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Roles: admin,reader,member Aug 09 18:09:20.112715 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c024e80f00ae4274ad841a20660b3ad2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c024e80f00ae4274ad841a20660b3ad2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c024e80f00ae4274ad841a20660b3ad2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c024e80f00ae4274ad841a20660b3ad2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:09:20.112715 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Tenant: admin Aug 09 18:09:20.112715 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Tenant-Id: c024e80f00ae4274ad841a20660b3ad2 Aug 09 18:09:20.112715 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-Tenant-Name: admin Aug 09 18:09:20.112715 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-User: admin Aug 09 18:09:20.112715 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-User-Domain-Id: default Aug 09 18:09:20.112715 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-User-Domain-Name: Default Aug 09 18:09:20.112715 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-User-Id: c800e45fdce14a59ae5bf0f84f3671cd Aug 09 18:09:20.112715 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: X-User-Name: admin Aug 09 18:09:20.112715 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: method: > Aug 09 18:09:20.112715 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: exception: Flavor 451 could not be found. Aug 09 18:09:20.112715 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: action_args: {'id': '451'} Aug 09 18:09:20.112715 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:09:20.112715 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:20.113595 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 18:09:20.113595 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 18:09:20.113595 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 18:09:20.113595 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 18:09:20.113595 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:09:20.113595 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:09:20.113595 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 18:09:20.113595 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 18:09:20.113595 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 18:09:20.113595 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:09:20.113595 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 18:09:20.113595 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 18:09:20.113595 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 18:09:20.113595 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Aug 09 18:09:20.113595 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:09:20.113595 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Aug 09 18:09:20.113595 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:20.113595 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:09:20.113595 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:09:20.114656 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:09:20.114656 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:09:20.114656 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:09:20.114656 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:09:20.114656 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 18:09:20.114656 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:09:20.114656 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 18:09:20.114656 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Aug 09 18:09:20.114656 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:09:20.114656 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Aug 09 18:09:20.114656 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:20.114656 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:09:20.114656 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:09:20.114656 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:09:20.114656 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:09:20.114656 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 18:09:20.114656 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Aug 09 18:09:20.114656 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-99699935-cc2d-4898-9230-84a93c6920c0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:09:20.115711 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-99699935-cc2d-4898-9230-84a93c6920c0 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.393448 Aug 09 18:09:20.115711 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 24/49] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Aug 9 18:09:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 18:09:20.122245 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-5580f309-24ac-4604-bedd-ed36d7c46783 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:20.137198 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-5580f309-24ac-4604-bedd-ed36d7c46783 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018658 Aug 09 18:09:20.137731 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 26/50] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Aug 9 18:09:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:09:20.147307 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-06adf275-7c66-4bcb-905f-9f5908dbdf44 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:20.162591 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-06adf275-7c66-4bcb-905f-9f5908dbdf44 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018752 Aug 09 18:09:20.163136 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 25/51] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Aug 9 18:09:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:09:20.172730 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-2867a27e-b350-428b-8c73-16871f869202 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:20.178018 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.wsgi [None req-2867a27e-b350-428b-8c73-16871f869202 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 18:09:20.179532 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-2867a27e-b350-428b-8c73-16871f869202 admin admin] Request method failure captured: Aug 09 18:09:20.179532 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 18:09:20.179532 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: Accept: application/json Aug 09 18:09:20.179532 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: Accept-Encoding: gzip, deflate Aug 09 18:09:20.179532 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: Connection: keep-alive Aug 09 18:09:20.179532 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: Content-Length: 0 Aug 09 18:09:20.179532 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: Host: 10.222.0.36 Aug 09 18:09:20.179532 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: Openstack-Api-Version: compute 2.90 Aug 09 18:09:20.179532 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: Openstack-System-Scope: None Aug 09 18:09:20.179532 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: User-Agent: python-novaclient Aug 09 18:09:20.179532 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Auth-Token: gAAAAABi8qLP2T0YcgoQMqfzV_R_WnsYUdvZTMvn0mFscwrQcdB_4fReTOWuQP6sxbMZh44aze1wPh2g5Pjl6DbZcLa2fvZx3xUDLjBiqMar-_qDdYL5irL4hizC41HPG62p-W9bvAX51pJ-UZOKHdFKbkFwRL7iLhLu-M-l8xzigYc7zyoq8zw Aug 09 18:09:20.179532 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Domain-Id: None Aug 09 18:09:20.179532 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Domain-Name: None Aug 09 18:09:20.179532 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Identity-Status: Confirmed Aug 09 18:09:20.179532 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Is-Admin-Project: True Aug 09 18:09:20.179532 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 18:09:20.179532 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Project-Domain-Id: default Aug 09 18:09:20.179532 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Project-Domain-Name: Default Aug 09 18:09:20.179532 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Project-Id: c024e80f00ae4274ad841a20660b3ad2 Aug 09 18:09:20.179532 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Project-Name: admin Aug 09 18:09:20.179532 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Role: admin,reader,member Aug 09 18:09:20.179532 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Roles: admin,reader,member Aug 09 18:09:20.181322 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c024e80f00ae4274ad841a20660b3ad2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c024e80f00ae4274ad841a20660b3ad2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c024e80f00ae4274ad841a20660b3ad2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c024e80f00ae4274ad841a20660b3ad2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:09:20.181322 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Tenant: admin Aug 09 18:09:20.181322 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Tenant-Id: c024e80f00ae4274ad841a20660b3ad2 Aug 09 18:09:20.181322 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-Tenant-Name: admin Aug 09 18:09:20.181322 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-User: admin Aug 09 18:09:20.181322 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-User-Domain-Id: default Aug 09 18:09:20.181322 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-User-Domain-Name: Default Aug 09 18:09:20.181322 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-User-Id: c800e45fdce14a59ae5bf0f84f3671cd Aug 09 18:09:20.181322 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: X-User-Name: admin Aug 09 18:09:20.181322 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: method: > Aug 09 18:09:20.181322 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: exception: Flavor 451 could not be found. Aug 09 18:09:20.181322 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: action_args: {'id': '451'} Aug 09 18:09:20.181322 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:09:20.181322 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:20.182334 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 18:09:20.182334 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 18:09:20.182334 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 18:09:20.182334 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 18:09:20.182334 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:09:20.182334 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:09:20.182334 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 18:09:20.182334 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 18:09:20.182334 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 18:09:20.182334 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:09:20.182334 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 18:09:20.182334 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 18:09:20.182334 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 18:09:20.182334 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Aug 09 18:09:20.182334 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:09:20.182334 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Aug 09 18:09:20.182334 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:20.182334 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:09:20.182334 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:09:20.183637 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:09:20.183637 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:09:20.183637 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:09:20.183637 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:09:20.183637 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 18:09:20.183637 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:09:20.183637 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 18:09:20.183637 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Aug 09 18:09:20.183637 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:09:20.183637 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Aug 09 18:09:20.183637 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:20.183637 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:09:20.183637 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:09:20.183637 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:09:20.183637 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:09:20.183637 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 18:09:20.183637 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Aug 09 18:09:20.183637 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-2867a27e-b350-428b-8c73-16871f869202 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:09:20.184818 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-2867a27e-b350-428b-8c73-16871f869202 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011621 Aug 09 18:09:20.184818 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 27/52] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Aug 9 18:09:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 09 18:09:21.153089 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-06adf275-7c66-4bcb-905f-9f5908dbdf44 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:21.154101 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-06adf275-7c66-4bcb-905f-9f5908dbdf44 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 09 18:09:21.154502 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 26/53] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Aug 9 18:09:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:09:21.682425 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-03a61cf5-706f-4bdb-854a-f7a245bd7071 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:09:21.770734 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-03a61cf5-706f-4bdb-854a-f7a245bd7071 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.476034 Aug 09 18:09:21.771291 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 28/54] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Aug 9 18:09:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:09:22.736914 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-06adf275-7c66-4bcb-905f-9f5908dbdf44 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:22.738050 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-06adf275-7c66-4bcb-905f-9f5908dbdf44 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001688 Aug 09 18:09:22.738443 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 27/55] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Aug 9 18:09:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:09:23.266788 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-9d62cb49-ea62-49e2-9139-bcf80800c590 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:09:23.336220 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-9d62cb49-ea62-49e2-9139-bcf80800c590 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.457591 Aug 09 18:09:23.336778 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 29/56] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Aug 9 18:09:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:09:24.306668 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-06adf275-7c66-4bcb-905f-9f5908dbdf44 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:24.307689 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-06adf275-7c66-4bcb-905f-9f5908dbdf44 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 09 18:09:24.308087 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 28/57] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Aug 9 18:09:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:09:24.827774 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-f83debd0-9dba-4f04-a529-a6f6bb02bbea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:09:24.908547 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-f83debd0-9dba-4f04-a529-a6f6bb02bbea admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.462916 Aug 09 18:09:24.909087 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 30/58] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Aug 9 18:09:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:09:25.894729 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-06adf275-7c66-4bcb-905f-9f5908dbdf44 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:25.895722 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-06adf275-7c66-4bcb-905f-9f5908dbdf44 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 09 18:09:25.896113 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 29/59] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Aug 9 18:09:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:09:26.414805 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-d07c4274-c094-4a5a-bfaa-73b470072d3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:09:26.519025 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-d07c4274-c094-4a5a-bfaa-73b470072d3a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.484087 Aug 09 18:09:26.519579 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 31/60] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Aug 9 18:09:26 2022] POST /compute/v2.1/flavors => generated 409 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:09:27.510242 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-06adf275-7c66-4bcb-905f-9f5908dbdf44 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:27.511279 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-06adf275-7c66-4bcb-905f-9f5908dbdf44 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001787 Aug 09 18:09:27.511669 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 30/61] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Aug 9 18:09:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:09:28.031902 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-c2598ab9-49df-424f-81e1-a3d8b59abb31 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:28.052176 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-c2598ab9-49df-424f-81e1-a3d8b59abb31 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.403064 Aug 09 18:09:28.052714 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 32/62] 10.222.0.36 () {60 vars in 1202 bytes} [Tue Aug 9 18:09:27 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:10:19.678124 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-06adf275-7c66-4bcb-905f-9f5908dbdf44 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:19.679170 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-06adf275-7c66-4bcb-905f-9f5908dbdf44 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001725 Aug 09 18:10:19.679567 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 31/63] 10.222.0.36 () {54 vars in 931 bytes} [Tue Aug 9 18:10:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:10:19.689967 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:10:20.065268 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-16f4eca7-adcf-450b-bbfe-26251bb97408 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:20.086503 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-16f4eca7-adcf-450b-bbfe-26251bb97408 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.400953 Aug 09 18:10:20.087079 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 33/64] 10.222.0.36 () {60 vars in 1292 bytes} [Tue Aug 9 18:10:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:10:20.110151 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-04c6d6db-dc5e-4cb0-9297-1a32003b6ee8 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:20.113595 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG dbcounter [-] [103787] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:10:20.119533 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-04c6d6db-dc5e-4cb0-9297-1a32003b6ee8 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013046 Aug 09 18:10:20.120054 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 32/65] 10.222.0.36 () {60 vars in 1283 bytes} [Tue Aug 9 18:10:20 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:10:20.132591 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-087a9655-8e16-4ceb-83d6-07eeeb828e5e admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:20.142303 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-087a9655-8e16-4ceb-83d6-07eeeb828e5e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011938 Aug 09 18:10:20.142303 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 34/66] 10.222.0.36 () {60 vars in 1286 bytes} [Tue Aug 9 18:10:20 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:10:20.151879 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-fe78444b-0686-4bd1-b9f2-844262004921 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:20.159884 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-fe78444b-0686-4bd1-b9f2-844262004921 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011558 Aug 09 18:10:20.160389 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 33/67] 10.222.0.36 () {60 vars in 1286 bytes} [Tue Aug 9 18:10:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:10:20.171869 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-50ace5fc-7b4a-43ce-917b-99fcf1ce8267 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:20.179960 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-50ace5fc-7b4a-43ce-917b-99fcf1ce8267 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011645 Aug 09 18:10:20.180475 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 35/68] 10.222.0.36 () {60 vars in 1283 bytes} [Tue Aug 9 18:10:20 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:24.219125 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-fe78444b-0686-4bd1-b9f2-844262004921 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:24.220125 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-fe78444b-0686-4bd1-b9f2-844262004921 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 09 18:13:24.220513 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 34/69] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Aug 9 18:13:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:13:24.363364 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writing DB stats nova_api:SELECT=6 {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:13:24.523183 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-99c88100-effc-4c35-af7f-3cce84f48b5d admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:24.525636 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 18:13:24.525636 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: warnings.warn(msg) Aug 09 18:13:24.527529 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-99c88100-effc-4c35-af7f-3cce84f48b5d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:24.528005 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-99c88100-effc-4c35-af7f-3cce84f48b5d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:24.528431 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-99c88100-effc-4c35-af7f-3cce84f48b5d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:24.529142 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-99c88100-effc-4c35-af7f-3cce84f48b5d admin admin] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:24.529586 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-99c88100-effc-4c35-af7f-3cce84f48b5d admin admin] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:24.530002 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-99c88100-effc-4c35-af7f-3cce84f48b5d admin admin] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:24.564342 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-99c88100-effc-4c35-af7f-3cce84f48b5d admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.202466 Aug 09 18:13:24.564893 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 36/70] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Aug 9 18:13:24 2022] GET /compute/v2.1/os-services => generated 791 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:13:25.407612 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-fe78444b-0686-4bd1-b9f2-844262004921 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:25.408612 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-fe78444b-0686-4bd1-b9f2-844262004921 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 09 18:13:25.409010 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 35/71] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Aug 9 18:13:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:13:25.603572 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-0e426294-8f1d-42ac-b2a0-8299e4df5da8 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:25.606730 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 18:13:25.606730 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: warnings.warn(msg) Aug 09 18:13:25.607889 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-0e426294-8f1d-42ac-b2a0-8299e4df5da8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:25.608372 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-0e426294-8f1d-42ac-b2a0-8299e4df5da8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:25.608806 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-0e426294-8f1d-42ac-b2a0-8299e4df5da8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:25.609525 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-0e426294-8f1d-42ac-b2a0-8299e4df5da8 admin admin] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:25.609969 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-0e426294-8f1d-42ac-b2a0-8299e4df5da8 admin admin] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:25.610385 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-0e426294-8f1d-42ac-b2a0-8299e4df5da8 admin admin] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:25.631208 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-0e426294-8f1d-42ac-b2a0-8299e4df5da8 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080927 Aug 09 18:13:25.631767 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 37/72] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Aug 9 18:13:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:13:36.848078 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-fe78444b-0686-4bd1-b9f2-844262004921 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:36.849076 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-fe78444b-0686-4bd1-b9f2-844262004921 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 09 18:13:36.849468 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 36/73] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Aug 9 18:13:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:13:36.995025 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writing DB stats nova_cell0:SELECT=4 {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:13:36.996066 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writing DB stats nova_cell1:SELECT=4 {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:13:36.996519 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writing DB stats nova_api:SELECT=8 {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:13:37.045120 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-546c088c-46b7-4423-a570-2ea31fc6240f admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:37.047530 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 18:13:37.047530 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: warnings.warn(msg) Aug 09 18:13:37.048642 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-546c088c-46b7-4423-a570-2ea31fc6240f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:37.049186 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-546c088c-46b7-4423-a570-2ea31fc6240f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:37.049616 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-546c088c-46b7-4423-a570-2ea31fc6240f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:37.050359 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-546c088c-46b7-4423-a570-2ea31fc6240f admin admin] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:37.051075 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-546c088c-46b7-4423-a570-2ea31fc6240f admin admin] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:37.051565 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-546c088c-46b7-4423-a570-2ea31fc6240f admin admin] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:37.077833 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-546c088c-46b7-4423-a570-2ea31fc6240f admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088191 Aug 09 18:13:37.078325 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 38/74] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Aug 9 18:13:36 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:13:37.917002 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-fe78444b-0686-4bd1-b9f2-844262004921 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:37.918046 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-fe78444b-0686-4bd1-b9f2-844262004921 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002375 Aug 09 18:13:37.918441 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 37/75] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Aug 9 18:13:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:13:38.112094 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-b08bc9e0-6775-4a88-ba92-ebe9ff51bfef admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:38.114454 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 18:13:38.114454 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: warnings.warn(msg) Aug 09 18:13:38.115570 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-b08bc9e0-6775-4a88-ba92-ebe9ff51bfef admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:38.116037 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-b08bc9e0-6775-4a88-ba92-ebe9ff51bfef admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:38.116490 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-b08bc9e0-6775-4a88-ba92-ebe9ff51bfef admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:38.117218 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-b08bc9e0-6775-4a88-ba92-ebe9ff51bfef admin admin] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:38.117659 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-b08bc9e0-6775-4a88-ba92-ebe9ff51bfef admin admin] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:38.118073 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-b08bc9e0-6775-4a88-ba92-ebe9ff51bfef admin admin] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:38.139947 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-b08bc9e0-6775-4a88-ba92-ebe9ff51bfef admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080281 Aug 09 18:13:38.140422 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 39/76] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Aug 9 18:13:38 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:14:37.296710 dv-cinder-797970-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 09 18:14:37.297583 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: Tue Aug 9 18:14:37 2022 - graceful shutdown triggered... Aug 09 18:14:37.298069 dv-cinder-797970-5-iscsi devstack@n-api.service[103786]: Gracefully killing worker 1 (pid: 103786)... Aug 09 18:14:37.298448 dv-cinder-797970-5-iscsi devstack@n-api.service[103787]: Gracefully killing worker 2 (pid: 103787)... Aug 09 18:14:38.298774 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: worker 1 buried after 1 seconds Aug 09 18:14:38.298774 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: worker 2 buried after 1 seconds Aug 09 18:14:38.298774 dv-cinder-797970-5-iscsi devstack@n-api.service[103785]: goodbye to uWSGI. Aug 09 18:14:38.300282 dv-cinder-797970-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 09 18:14:38.300862 dv-cinder-797970-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 09 18:14:38.303759 dv-cinder-797970-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 18:14:38.313483 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 18:14:38.316092 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 18:14:38 2022] *** Aug 09 18:14:38.316247 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 18:14:38.316377 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 18:14:38.316493 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: nodename: dv-cinder-797970-5-iscsi Aug 09 18:14:38.316607 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: machine: x86_64 Aug 09 18:14:38.316728 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: clock source: unix Aug 09 18:14:38.316842 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: pcre jit disabled Aug 09 18:14:38.316949 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: detected number of CPU cores: 4 Aug 09 18:14:38.317046 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: current working directory: / Aug 09 18:14:38.317154 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: detected binary path: /usr/bin/uwsgi-core Aug 09 18:14:38.317154 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: your processes number limit is 47680 Aug 09 18:14:38.317154 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: your memory page size is 4096 bytes Aug 09 18:14:38.317154 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: detected max file descriptor number: 2048 Aug 09 18:14:38.317154 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: lock engine: pthread robust mutexes Aug 09 18:14:38.317549 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: thunder lock: enabled Aug 09 18:14:38.317549 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 18:14:38.317700 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 18:14:38.357001 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: Python main interpreter initialized at 0x5652434e09c0 Aug 09 18:14:38.357001 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: python threads support enabled Aug 09 18:14:38.357001 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: your server socket listen backlog is limited to 100 connections Aug 09 18:14:38.357001 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: your mercy for graceful operations on workers is 90 seconds Aug 09 18:14:38.357406 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 18:14:38.357406 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: *** Operational MODE: preforking *** Aug 09 18:14:38.357684 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: *** uWSGI is running in multiple interpreter mode *** Aug 09 18:14:38.357684 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: spawned uWSGI master process (pid: 118303) Aug 09 18:14:38.357887 dv-cinder-797970-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 09 18:14:38.358488 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: spawned uWSGI worker 1 (pid: 118313, cores: 1) Aug 09 18:14:38.358824 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: spawned uWSGI worker 2 (pid: 118314, cores: 1) Aug 09 18:14:38.362751 dv-cinder-797970-5-iscsi devstack@n-api.service[118303]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 18:14:39.033004 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 18:14:39.037279 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 18:14:40.189717 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 18:14:40.189717 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: from cryptography.utils import int_from_bytes Aug 09 18:14:40.190421 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 18:14:40.190421 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: from cryptography.utils import int_from_bytes Aug 09 18:14:40.214755 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 18:14:40.214755 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: from cryptography.utils import int_from_bytes Aug 09 18:14:40.215283 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 18:14:40.215283 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: from cryptography.utils import int_from_bytes Aug 09 18:14:42.528108 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 18:14:42.528703 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 18:14:42.528935 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 18:14:42.529295 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 18:14:42.529463 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 18:14:42.529850 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.530173 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.530490 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.530832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.531162 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.531472 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.531788 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.532112 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.532437 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.532695 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.533005 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.533326 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797970-5-iscsi {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.533644 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.533949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.534254 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.534635 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.534998 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.535318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.535622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.536117 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.537564 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.537564 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.537564 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.537564 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.538456 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.538604 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.538930 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.539239 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.539538 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.539841 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.540263 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797970-5-iscsi {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.540593 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.540860 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.541192 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.541592 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.541898 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.542192 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.542507 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.542855 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.543185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.543497 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.543821 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.544151 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.544453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.544758 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.545062 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.545369 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.545685 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.545988 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.546291 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.546541 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.546869 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.547190 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.547509 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.547837 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.548083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.548331 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.548647 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.548966 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.549294 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.549578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.549884 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.550271 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.550584 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.550913 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.551213 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.551524 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.551839 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.552157 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.552471 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.552775 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.553092 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.553503 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.554346 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.554657 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.554957 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.555245 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.555549 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.555865 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.556183 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.556488 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.556793 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.557097 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.557410 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.557740 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.558043 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.558292 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.558454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 18:14:42.559002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.559160 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 18:14:42.559304 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.559457 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 18:14:42.559601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.559601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.559900 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 18:14:42.559900 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 18:14:42.560205 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.560205 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.560499 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.560673 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.561020 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.561179 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.561325 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.561467 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.561714 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.561863 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.562025 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.562196 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.562436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.562585 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.562765 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.562934 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.563110 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.563342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.563501 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.563651 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.563795 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.563955 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.564110 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.564261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.564462 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797970-5-iscsi {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.564638 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.564934 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.565095 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.565277 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.565674 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.565873 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.566041 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.566207 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.566361 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.566507 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.566686 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.566877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.567021 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.567184 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.567334 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.567334 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.567630 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.567800 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.567954 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.568105 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.568249 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.568398 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.568556 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.568700 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.568850 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.569000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.569201 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.569368 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.569522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.569672 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.569824 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.569968 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.570112 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.570268 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.570429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.570571 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.570745 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.570934 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.572684 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797970-5-iscsi {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.572864 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.573037 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.573238 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.573503 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.573662 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.573818 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.573971 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.574116 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.574273 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.574426 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.574630 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.574825 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.578504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.578695 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.578921 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.579088 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.579260 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.579410 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.579554 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.579554 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.579829 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.579983 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.580138 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.580291 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.581833 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.582008 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.582208 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.582376 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.582573 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.582573 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.582938 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.583084 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.583239 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.583401 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.583573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.583721 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.583878 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.584024 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.584174 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.584345 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.584498 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.584693 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.584921 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.585129 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.585284 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.585523 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.585681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.587284 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.587466 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.587623 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.587784 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.587944 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.588097 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.588242 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.588386 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.588532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.588696 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.588853 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.589007 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.589158 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.590200 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.590371 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.590519 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.590731 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.590885 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.591068 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.591247 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.591410 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.592229 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.592936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.593095 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.593306 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.593470 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.594762 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.595103 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.595297 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.595449 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.595604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.595604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.595895 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.596067 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.596259 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.596259 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.596586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.596586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.596868 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.597021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.597183 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.598166 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.598340 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.598497 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.598643 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.598831 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.598990 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.599152 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.599304 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.599519 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.599674 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.599826 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.599981 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.600309 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.600950 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.601105 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.601248 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.601411 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.601798 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.601798 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.602069 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.602069 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.602276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.602387 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.602508 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.602628 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.602769 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.612029 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.612194 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.612343 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.612615 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.612783 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.612930 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.613081 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.613232 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.613377 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.613534 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.613687 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.613882 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.614072 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.614216 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.614368 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.614532 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.614689 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.614909 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.615060 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.615213 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.615631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.615791 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.615949 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.616714 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.616935 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.617089 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.617249 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.617407 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.617559 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.617737 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.618400 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.618651 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.618862 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.619019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.619180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.619352 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.619517 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.619675 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.619827 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.620128 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.620314 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.620626 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.620798 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.620957 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.621110 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.621268 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.621426 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.621426 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.621721 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.621721 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.622036 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.622301 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.622479 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.622639 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.622858 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.623012 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.623170 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.623328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.623479 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.623644 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.623796 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.623946 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.624108 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.624266 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.624425 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.624597 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.624754 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.624953 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.625111 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.625262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.625420 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.625584 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.625743 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.625900 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.626132 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.626132 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.626443 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.626614 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.626803 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.626962 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.627166 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.627332 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.627493 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.627651 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.627801 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.627961 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.628602 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.628893 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.629065 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.629219 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.629369 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.629521 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.629715 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.629879 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.630135 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.630370 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:14:42.630554 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.630886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.631053 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.631206 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.631382 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.631382 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.632303 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.632520 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.632678 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.632844 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.633017 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.633226 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.633382 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.633531 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.633691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.633872 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.634343 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.634525 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.634717 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.634877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.635082 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.635248 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.635447 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.635636 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.635796 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.635946 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.636096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.636260 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.636463 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.636637 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.636791 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.636941 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.637107 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.637259 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.637417 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.637606 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.637758 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.637917 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.638077 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.638252 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.638897 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.639161 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.639338 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.639490 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.639694 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.639853 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.640012 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.640171 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.640352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.640659 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.640969 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.641091 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.641240 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.641363 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.641476 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.641639 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.641639 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.641865 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.641977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.642088 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.642198 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.642319 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.642430 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.642540 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.642540 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.651265 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.651470 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.651652 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.651652 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.651980 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.652133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.652284 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.652442 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.652610 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.652762 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.652944 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.653098 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.653249 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.653449 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.653611 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.653770 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.653965 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.654127 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.654287 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.654452 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.654611 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.654852 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.655017 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.655210 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.655210 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.655559 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.655753 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.655916 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.656079 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.656230 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.656387 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.656642 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.656808 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.657002 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.657158 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.657308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.657499 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.657664 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.657822 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.658017 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.658180 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.658351 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.658510 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.659074 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.659270 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.659512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.659668 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.659819 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.659988 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.660141 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.660298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.660509 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.660682 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.660909 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.661121 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.661434 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.661638 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.661804 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.661804 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.662143 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.662143 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.662143 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.662143 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.662143 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.662143 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.663111 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.663263 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.663473 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.663636 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.663795 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.663951 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.664112 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.664262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.664412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.664569 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.664720 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.664869 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.665032 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.665184 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.665387 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.665550 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.665734 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.665971 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.666153 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.666306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.666464 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.666621 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.666808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.666976 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.667128 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.667286 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.667437 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.667604 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.667755 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.667917 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.668075 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.668274 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.668274 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.668720 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.669264 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.669440 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.669756 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.669914 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.670073 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.670266 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.670434 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.670633 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.670808 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.671050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.671221 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.671663 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.671834 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.671988 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.672138 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.672297 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.672495 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.672681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.672916 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.673090 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.673090 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.673375 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.673574 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.673766 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.673932 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.674089 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.674240 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.674396 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.674556 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.674751 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.674928 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.675098 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.675258 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.675594 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.675794 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.675922 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.676044 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.676166 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.676287 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.676287 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.676460 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.676556 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.676642 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.676726 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.676726 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.676905 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.676905 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.677069 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.677154 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.677245 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.677330 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.677414 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.677496 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.677609 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.677696 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.677780 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.677780 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.677958 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.678057 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.678150 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.678150 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.678304 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.678400 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.678515 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.678608 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.678751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.679536 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.679908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.679908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.680141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.680141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.680359 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.680477 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.680603 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.680723 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.680837 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.680991 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.681519 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.681790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.681923 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.682051 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.682196 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.682452 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.682597 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.682805 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.687281 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.688079 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.688205 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.688330 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.688447 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.688558 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.688678 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.688798 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.688917 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.689055 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.689447 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.689685 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.689817 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.690077 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.690213 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.690384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.690517 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.690645 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.690838 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.690969 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.691100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.691234 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.691357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.691485 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.691699 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.691987 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.692121 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.692246 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.692360 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.692360 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.692572 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.692691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.692825 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.692953 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.693066 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.693178 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.693295 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.693418 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.693541 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.693661 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.693774 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.693894 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.694006 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.694673 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.694825 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.694942 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.695080 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.695554 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.695691 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.695815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.695928 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.696040 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.696150 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.696332 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.696462 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.696591 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.696720 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.697099 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.697252 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.697370 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.697490 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.697775 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.697924 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.698237 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.698378 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.698623 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.698844 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.698844 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.700027 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.700169 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.700286 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.700397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.700521 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.700642 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.700772 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.701169 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.701292 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.701412 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.701575 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.701724 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.701844 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.702118 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.702214 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.702307 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.702403 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.702496 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.702646 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.702791 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.702896 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.702993 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.703120 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.703210 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.703297 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.703381 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.703473 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.703568 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.703662 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.703748 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.703833 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.703925 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.704019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.704135 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.704219 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.704299 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.704385 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.704471 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.704563 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.704666 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.704760 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.704845 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.704930 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.705013 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.705106 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.705250 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.705344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.705437 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.705523 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.705606 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.705704 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.705799 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.705887 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.705971 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.705971 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.706133 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.706297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.706436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.706537 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.706632 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.706782 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.708471 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.708607 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.708844 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.708844 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.709068 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.709170 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.709269 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.709269 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.709430 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.709522 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.709688 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.710884 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.711127 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.711402 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.711575 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.711729 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.711877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.711877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.712356 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.712519 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.712785 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.712785 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.712958 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.713055 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.713151 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.713236 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.713319 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.713453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.713453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.713646 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.713738 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.713820 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.713820 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.713982 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.714075 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.714172 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.714172 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.714344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.714434 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.714527 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.714611 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.714780 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.714927 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.715032 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.715118 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.715264 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.715353 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.715445 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.715529 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.715620 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.715717 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.715803 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.715893 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.715979 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.716070 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.716156 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.716258 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.716344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.716472 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.716577 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.716663 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.716748 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.716840 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.716925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.717008 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.717099 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.717183 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.717266 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.717362 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.717456 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.717548 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.717633 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.717723 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.717810 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.717981 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.718092 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.718180 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.718265 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.718265 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.718428 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.718514 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.718659 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.718766 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.718852 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.718970 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.719070 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.719156 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.719238 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.719238 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.719400 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.719498 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.719584 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.719717 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.719798 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.719937 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.720051 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.720175 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.720297 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.720297 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.720571 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.720938 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.721069 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.721203 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.721203 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.721464 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.721601 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.721738 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.721827 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.721925 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.722019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.722196 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.722990 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.723137 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.723243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.723332 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.723429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.723516 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.723602 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.723681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.723764 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.723898 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.723993 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.724086 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.724172 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.724255 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.724348 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.724433 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.724517 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.724599 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.724683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.724764 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.724857 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.724950 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.725036 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.725120 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.725204 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.725306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.725503 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.725624 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.725701 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.725781 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.725862 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.725947 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.726028 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.726150 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.726272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.726272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.726407 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.726493 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.726646 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.726751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.726838 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.726935 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.727066 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.727190 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.727291 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.727378 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.727470 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.727556 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.727648 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.727733 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.727824 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.727911 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.727995 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.728079 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.728175 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.728262 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.728353 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.728473 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.728571 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.728658 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.728754 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.728844 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.728929 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.729003 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.729073 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.729152 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.729233 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.729305 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.729383 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.729455 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.729526 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.729606 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.729606 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.729758 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.729851 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.729935 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.730055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.730175 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.730295 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.730418 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.730531 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.730640 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.731021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.731930 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.732062 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.732183 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.732297 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.732415 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.732537 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.732659 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.732778 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.732896 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.732896 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.733216 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.733343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.733464 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.733582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.733695 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.733813 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.733925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.734048 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.734168 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.734279 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.734279 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.734493 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.734602 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.734602 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.734973 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.735092 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.735211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.735322 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.735439 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.735562 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.735797 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.735940 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.736072 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.736205 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.736336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.736466 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.736578 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.736728 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.736824 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.736909 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.737004 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.737088 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.737172 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.737263 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.737348 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.737431 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.737517 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.737599 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.737672 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.737750 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.737836 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.737968 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.738066 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.738153 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.738226 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.738303 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.738376 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.738446 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.738525 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.738616 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.738716 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.738804 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.738889 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.738986 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.739073 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.739155 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.739245 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.739336 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.739434 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.739531 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.739626 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.739699 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.739769 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.739853 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.739927 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.739997 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.740067 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.740137 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.740215 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.740598 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.740720 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.740847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.741078 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.741312 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.741504 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.741640 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.741755 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.741872 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.742093 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.742295 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.742389 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.742473 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.742559 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.742644 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.742756 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.742854 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.742952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.743034 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.743127 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.743226 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.743321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.743412 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.743506 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.743593 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.743689 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.743775 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.743867 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.743959 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.744054 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.744140 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.744224 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.744307 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.744400 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.744492 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.744492 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.744662 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.744746 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.744830 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.744912 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.745009 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.745096 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.745188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.745280 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.745366 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.745450 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.745542 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.745634 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.745726 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.745819 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.745912 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.745996 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.746094 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.746185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.746270 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.746348 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.746428 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.746499 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.746583 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.746583 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.746998 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.747096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.747189 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.747286 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.747372 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.747464 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.747549 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.747633 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.747716 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.747716 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.747882 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.747973 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.748066 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.748151 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.748235 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.748328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.748421 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.748506 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.748590 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.748681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.748851 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.748940 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.749024 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.749116 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.749116 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.749288 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.749386 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.749482 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.749571 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.749657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.749740 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.749830 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.749928 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.750021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.750114 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.750199 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.750288 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.750384 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.750469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.750553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.750643 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.750734 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.750810 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.750899 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.750985 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.751151 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.751267 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.751345 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.751416 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.751501 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.751594 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.751680 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.751771 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.751771 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.751927 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.752013 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.752268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.752371 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.752467 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.752467 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.752635 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.752729 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.752813 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.752905 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.752991 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.753075 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.753167 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.753253 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.753344 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.753344 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.753529 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.753650 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.753736 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.753865 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.753979 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.753979 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.754193 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.754320 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.754439 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.754559 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.754669 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.754780 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.758134 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.758353 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.758353 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.758353 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.758353 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.758660 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.759373 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.759485 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.759582 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.759675 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.759769 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.759859 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.759950 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.760099 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.760197 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.760290 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.760376 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.760467 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.760565 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.760650 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.760735 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.760869 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.760970 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.761064 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.761159 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.761232 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.761304 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.761395 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.761471 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.761548 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.761642 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.761728 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.761813 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.761895 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.761987 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.761987 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.762152 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.762325 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.762426 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.762514 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.762598 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.762698 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.762840 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.762932 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.763016 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.763016 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.763191 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.763191 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.763361 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.763452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.763536 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.763615 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.763698 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.763795 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.763893 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.763978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.764061 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.764151 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.764235 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.764328 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.764408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.764487 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.764559 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.764676 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.764826 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.764949 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.765066 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.765066 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.765273 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.765384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.765541 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.765665 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.765766 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.765766 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.765929 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.766016 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.766097 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.766176 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.766247 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.766324 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.766395 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.766466 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.766545 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.766645 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.766736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.766812 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.766895 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.766986 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.767065 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.767144 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.767402 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.767485 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.767566 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.767647 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.767721 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.767793 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.767869 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.767941 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.768012 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.768094 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.768166 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.768244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.768323 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.768323 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.768452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.768452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.768589 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.768589 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.768731 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.768731 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.768880 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.768960 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.769038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.769038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.769166 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.769244 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.769324 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.769396 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.769466 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.769536 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.769615 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.769693 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.769842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.769916 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.769987 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.770056 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.770127 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.770127 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.770264 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.770338 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.770408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.770485 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.770556 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.770635 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.770725 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.770803 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.770879 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.770963 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.771043 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.771043 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.771185 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.771264 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.771336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.771406 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.771483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.771671 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.771756 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.771835 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.771915 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.771986 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.772067 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.772140 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.772273 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.772927 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.773009 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.773081 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.773165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.773244 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.773317 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.773395 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.773395 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.773545 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.773617 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.773688 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.773757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.773834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.773906 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.773986 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.774057 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.774134 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.774204 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.774274 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.774344 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.774423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.774495 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.774572 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.774666 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.774779 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.774874 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.774968 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.775053 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.775136 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.775226 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.775311 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.775407 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.775493 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.775586 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.775672 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.775751 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.775823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.775906 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.775979 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.776057 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.776136 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.776214 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.776214 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.776357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.776357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.776483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.776553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.776644 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.776771 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.776862 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.776937 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.777007 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.777077 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.777155 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.777963 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.778080 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.778178 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.778264 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.778356 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.778455 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.778555 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.778648 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.778876 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.778980 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.779120 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.779232 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.779334 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.779427 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.779519 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.779603 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.779687 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.779687 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.779687 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.779930 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.780015 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.780106 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.780191 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.780287 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.780374 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.780456 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.780554 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.780642 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.780738 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.780830 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.780922 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.781008 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.781098 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.781189 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.781189 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.781365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.781438 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.781438 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.781438 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.781438 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.781720 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.781855 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.781954 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.782039 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.782123 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.782229 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.782326 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.782406 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.782490 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.782573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.782664 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.782784 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.782873 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.782964 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.783049 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.783139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.783231 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.783324 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.783416 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.783500 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.783586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.783658 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.783729 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.783824 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.783917 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.784008 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.784094 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.784166 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.784250 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.784335 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.784335 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.784335 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.784335 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.784841 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.785022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.785178 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.785331 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.785482 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.785629 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.785782 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.785960 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.786111 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.786267 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.786423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.786585 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.786761 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.788879 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.789060 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.789279 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.789462 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.789563 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.789659 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.789755 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.789850 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.789943 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.790036 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.790121 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.790290 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.790385 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.790385 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.790551 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.790551 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.790725 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.790725 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.790906 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.790991 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.791076 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.791167 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.791259 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.791357 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.791459 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.791591 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.791694 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.791781 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.791866 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.792000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.792102 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.792195 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.792282 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.792371 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.792371 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.792539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.792629 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.792714 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.792805 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.792891 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.792988 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.793081 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.793081 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.793242 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.793324 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.793418 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.793513 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.793597 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.793815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.793921 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.794006 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.794102 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.794189 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.794273 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.794410 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.794499 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.794583 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.794676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.794880 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.794976 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.795070 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.795154 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.795238 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.795334 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.795421 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.795421 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.795581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.795581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.795743 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.795835 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.795910 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.795910 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.796053 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.796137 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.796229 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.796315 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.796398 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.796398 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 18:14:42.796554 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.796554 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.796554 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.796554 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.796554 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.796554 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.796554 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.796554 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.797135 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.797135 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.797135 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.797135 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.797135 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.797135 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.797135 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.797135 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.797943 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.797943 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.797943 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.797943 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.797943 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.797943 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.797943 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.797943 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.798737 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.798737 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.798737 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.799102 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.799102 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.799397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.799706 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.800014 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.800325 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.800646 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.800955 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.801262 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.801566 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.801875 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.802183 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.802486 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.802845 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.803153 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.803574 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.804043 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.804395 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.804854 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.805197 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.805599 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.805934 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.806275 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.806607 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.808975 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.808975 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.808975 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.808975 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.808975 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.808975 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.808975 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.809594 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.809594 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.809889 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.810209 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.810542 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.810912 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.811248 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.811571 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.811991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.812244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.812565 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.812989 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.813209 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.813531 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.813857 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.814206 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.814545 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.814899 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.815239 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.815567 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.815903 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.816231 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.816552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.816893 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.817216 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.817537 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.817859 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.818181 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.818500 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.818858 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.820000 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.820249 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.820393 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.820721 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.821061 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.821395 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.821717 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.822140 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.822383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.822779 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.823103 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.823461 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.823809 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.824150 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.824450 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.824767 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:14:42.825024 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 18:14:42.949681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO dbcounter [None req-84f2943b-c5ed-448d-a702-7f1c16ca4da5 None None] Registered counter for database nova_api Aug 09 18:14:42.971334 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_db.sqlalchemy.engines [None req-84f2943b-c5ed-448d-a702-7f1c16ca4da5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:14:42.978865 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writer thread running {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:14:42.979087 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO dbcounter [None req-3ac8e4ed-c95d-4d20-9004-19fea17e9220 None None] Registered counter for database nova_api Aug 09 18:14:42.999268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_db.sqlalchemy.engines [None req-3ac8e4ed-c95d-4d20-9004-19fea17e9220 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118313) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:14:43.006208 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writer thread running {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:14:43.035607 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.context [None req-84f2943b-c5ed-448d-a702-7f1c16ca4da5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87906804-98dc-4bc9-abd9-60a13ec853ee(cell1) {{(pid=118314) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 18:14:43.040619 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-84f2943b-c5ed-448d-a702-7f1c16ca4da5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:43.041100 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-84f2943b-c5ed-448d-a702-7f1c16ca4da5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:43.042655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-84f2943b-c5ed-448d-a702-7f1c16ca4da5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:43.043416 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-84f2943b-c5ed-448d-a702-7f1c16ca4da5 None None] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:43.043868 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-84f2943b-c5ed-448d-a702-7f1c16ca4da5 None None] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:43.045845 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-84f2943b-c5ed-448d-a702-7f1c16ca4da5 None None] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:43.047909 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO dbcounter [None req-84f2943b-c5ed-448d-a702-7f1c16ca4da5 None None] Registered counter for database nova_cell0 Aug 09 18:14:43.052344 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO dbcounter [None req-84f2943b-c5ed-448d-a702-7f1c16ca4da5 None None] Registered counter for database nova_cell1 Aug 09 18:14:43.062036 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_db.sqlalchemy.engines [None req-84f2943b-c5ed-448d-a702-7f1c16ca4da5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:14:43.063233 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_db.sqlalchemy.engines [None req-84f2943b-c5ed-448d-a702-7f1c16ca4da5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:14:43.069065 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.context [None req-3ac8e4ed-c95d-4d20-9004-19fea17e9220 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87906804-98dc-4bc9-abd9-60a13ec853ee(cell1) {{(pid=118313) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 18:14:43.071774 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writer thread running {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:14:43.073055 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writer thread running {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:14:43.073432 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3ac8e4ed-c95d-4d20-9004-19fea17e9220 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:43.074097 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3ac8e4ed-c95d-4d20-9004-19fea17e9220 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:43.076599 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3ac8e4ed-c95d-4d20-9004-19fea17e9220 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:43.077653 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3ac8e4ed-c95d-4d20-9004-19fea17e9220 None None] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:43.078338 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3ac8e4ed-c95d-4d20-9004-19fea17e9220 None None] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:43.080606 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3ac8e4ed-c95d-4d20-9004-19fea17e9220 None None] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:43.082725 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO dbcounter [None req-3ac8e4ed-c95d-4d20-9004-19fea17e9220 None None] Registered counter for database nova_cell0 Aug 09 18:14:43.089371 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO dbcounter [None req-3ac8e4ed-c95d-4d20-9004-19fea17e9220 None None] Registered counter for database nova_cell1 Aug 09 18:14:43.098812 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_db.sqlalchemy.engines [None req-3ac8e4ed-c95d-4d20-9004-19fea17e9220 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118313) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:14:43.101171 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_db.sqlalchemy.engines [None req-3ac8e4ed-c95d-4d20-9004-19fea17e9220 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118313) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:14:43.107430 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writer thread running {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:14:43.109018 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writer thread running {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:14:43.218098 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO dbcounter [None req-84f2943b-c5ed-448d-a702-7f1c16ca4da5 None None] Registered counter for database nova_cell0 Aug 09 18:14:43.224859 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_db.sqlalchemy.engines [None req-84f2943b-c5ed-448d-a702-7f1c16ca4da5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:14:43.230219 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writer thread running {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:14:43.252774 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO dbcounter [None req-3ac8e4ed-c95d-4d20-9004-19fea17e9220 None None] Registered counter for database nova_cell0 Aug 09 18:14:43.261519 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_db.sqlalchemy.engines [None req-3ac8e4ed-c95d-4d20-9004-19fea17e9220 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118313) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:14:43.266001 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writer thread running {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:14:43.547425 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: WARNING keystonemiddleware.auth_token [None req-84f2943b-c5ed-448d-a702-7f1c16ca4da5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 18:14:43.554966 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: WARNING keystonemiddleware.auth_token [None req-84f2943b-c5ed-448d-a702-7f1c16ca4da5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 18:14:43.587470 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: WARNING keystonemiddleware.auth_token [None req-3ac8e4ed-c95d-4d20-9004-19fea17e9220 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 18:14:43.594954 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: WARNING keystonemiddleware.auth_token [None req-3ac8e4ed-c95d-4d20-9004-19fea17e9220 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 18:14:43.904765 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: WARNING keystonemiddleware.auth_token [None req-84f2943b-c5ed-448d-a702-7f1c16ca4da5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 18:14:43.910733 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: WARNING keystonemiddleware.auth_token [None req-84f2943b-c5ed-448d-a702-7f1c16ca4da5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 18:14:43.917046 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5652434e09c0 pid: 118314 (default app) Aug 09 18:14:43.943432 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: WARNING keystonemiddleware.auth_token [None req-3ac8e4ed-c95d-4d20-9004-19fea17e9220 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 18:14:43.950272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: WARNING keystonemiddleware.auth_token [None req-3ac8e4ed-c95d-4d20-9004-19fea17e9220 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 18:14:43.956530 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5652434e09c0 pid: 118313 (default app) Aug 09 18:15:19.975549 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=3 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:15:19.976405 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=3 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:15:19.977085 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=3 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:15:19.977802 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=3 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:15:21.067385 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=3 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:15:21.068835 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=3 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:15:21.070210 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=3 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:15:21.071042 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=3 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:15:21.623537 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-4e0996b8-c705-42a2-999f-0b2bb02ab126 tempest-VolumesGetTestJSON-1236755487 tempest-VolumesGetTestJSON-1236755487-project] Action: 'create', calling method: .version_select at 0x7f4c3733de50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-65098407", "metadata": {"Type": "work"}}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:15:22.467742 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9cfcadfe-09ee-4c50-973e-874a009f7194 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Action: 'create', calling method: .version_select at 0x7f4c37346dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1981158980"}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:15:24.198239 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-4e0996b8-c705-42a2-999f-0b2bb02ab126 tempest-VolumesGetTestJSON-1236755487 tempest-VolumesGetTestJSON-1236755487-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 4.238449 Aug 09 18:15:24.208343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1156 bytes} [Tue Aug 9 18:15:19 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 4251 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 09 18:15:24.214645 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-224c8432-a40d-4bc5-93c6-8e6137fa916d tempest-VolumesGetTestJSON-1236755487 tempest-VolumesGetTestJSON-1236755487-project] Calling method '.version_select at 0x7f4c371bdca0>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:24.580846 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-224c8432-a40d-4bc5-93c6-8e6137fa916d tempest-VolumesGetTestJSON-1236755487 tempest-VolumesGetTestJSON-1236755487-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/8ded4e95-09ec-416f-a750-282c417bd7de" status: 200 len: 351 microversion: 2.1 time: 0.370398 Aug 09 18:15:24.581676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 2/2] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Aug 9 18:15:24 2022] GET /compute/v2.1/os-volumes/8ded4e95-09ec-416f-a750-282c417bd7de => generated 351 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:15:25.042599 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9cfcadfe-09ee-4c50-973e-874a009f7194 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.814585 Aug 09 18:15:25.042599 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 1/3] 10.222.0.36 () {60 vars in 1155 bytes} [Tue Aug 9 18:15:21 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3817 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 09 18:15:25.044055 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-809c712b-c998-48b3-a55d-809e6b9cafde tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Calling method '.version_select at 0x7f4c371d33a0>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:25.044055 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-809c712b-c998-48b3-a55d-809e6b9cafde tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/ae51ae62-dad0-47cb-a12d-6ebca32ddc40" status: 200 len: 345 microversion: 2.1 time: 0.150607 Aug 09 18:15:25.044055 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 3/4] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Aug 9 18:15:24 2022] GET /compute/v2.1/os-volumes/ae51ae62-dad0-47cb-a12d-6ebca32ddc40 => generated 345 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:15:25.595639 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-8f97aefe-9118-4081-b920-f56edaf94ccf tempest-VolumesGetTestJSON-1236755487 tempest-VolumesGetTestJSON-1236755487-project] Calling method '.version_select at 0x7f4c37235c10>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:25.713841 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-8f97aefe-9118-4081-b920-f56edaf94ccf tempest-VolumesGetTestJSON-1236755487 tempest-VolumesGetTestJSON-1236755487-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/8ded4e95-09ec-416f-a750-282c417bd7de" status: 200 len: 352 microversion: 2.1 time: 0.122488 Aug 09 18:15:25.714686 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 2/5] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Aug 9 18:15:25 2022] GET /compute/v2.1/os-volumes/8ded4e95-09ec-416f-a750-282c417bd7de => generated 352 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:15:25.727962 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-4243a3a7-fe15-4d6e-aa5f-c69b326646f7 tempest-VolumesGetTestJSON-1236755487 tempest-VolumesGetTestJSON-1236755487-project] Calling method '.version_select at 0x7f4c371d3af0>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:25.837499 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-4243a3a7-fe15-4d6e-aa5f-c69b326646f7 tempest-VolumesGetTestJSON-1236755487 tempest-VolumesGetTestJSON-1236755487-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/8ded4e95-09ec-416f-a750-282c417bd7de" status: 200 len: 352 microversion: 2.1 time: 0.114498 Aug 09 18:15:25.838534 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 4/6] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Aug 9 18:15:25 2022] GET /compute/v2.1/os-volumes/8ded4e95-09ec-416f-a750-282c417bd7de => generated 352 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:15:25.861612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-8aff2170-268b-4e58-a5ca-95607b31575d tempest-VolumesGetTestJSON-1236755487 tempest-VolumesGetTestJSON-1236755487-project] Calling method '.version_select at 0x7f4c371d6430>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:26.057086 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-af62a889-ef7c-42a6-8423-24791a57b9de tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Calling method '.version_select at 0x7f4c371bdd30>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:26.381784 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-8aff2170-268b-4e58-a5ca-95607b31575d tempest-VolumesGetTestJSON-1236755487 tempest-VolumesGetTestJSON-1236755487-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/8ded4e95-09ec-416f-a750-282c417bd7de" status: 202 len: 0 microversion: 2.1 time: 0.525869 Aug 09 18:15:26.386583 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 3/7] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Aug 9 18:15:25 2022] DELETE /compute/v2.1/os-volumes/8ded4e95-09ec-416f-a750-282c417bd7de => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:15:26.417123 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-1f92f0de-4408-43cb-9643-c3647b49ae23 tempest-VolumesGetTestJSON-1236755487 tempest-VolumesGetTestJSON-1236755487-project] Calling method '.version_select at 0x7f4c371d6af0>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:26.651440 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-af62a889-ef7c-42a6-8423-24791a57b9de tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/ae51ae62-dad0-47cb-a12d-6ebca32ddc40" status: 200 len: 346 microversion: 2.1 time: 0.605287 Aug 09 18:15:26.651696 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 5/8] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Aug 9 18:15:26 2022] GET /compute/v2.1/os-volumes/ae51ae62-dad0-47cb-a12d-6ebca32ddc40 => generated 346 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:15:26.665624 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f8fb7244-1bdf-4a1b-993f-822a2b3684bb tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Action: 'create', calling method: .version_select at 0x7f4c371d3ca0>, body: {"snapshot": {"volume_id": "ae51ae62-dad0-47cb-a12d-6ebca32ddc40", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1309464790"}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:15:26.988915 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-1f92f0de-4408-43cb-9643-c3647b49ae23 tempest-VolumesGetTestJSON-1236755487 tempest-VolumesGetTestJSON-1236755487-project] HTTP exception thrown: Volume 8ded4e95-09ec-416f-a750-282c417bd7de could not be found. Aug 09 18:15:27.011553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-1f92f0de-4408-43cb-9643-c3647b49ae23 tempest-VolumesGetTestJSON-1236755487 tempest-VolumesGetTestJSON-1236755487-project] Request method failure captured: Aug 09 18:15:27.011553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: GET /compute/v2.1/os-volumes/8ded4e95-09ec-416f-a750-282c417bd7de HTTP/1.1 Aug 09 18:15:27.011553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:15:27.011553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:15:27.011553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:15:27.011553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:15:27.011553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:15:27.011553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:15:27.011553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:15:27.011553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:15:27.011553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qQ3The-XRjOz57KQ3n17Avffby7SsGX0aH933FRfpi9RjOnSee5WCjaDSdy8-EqTBGTa8141VlM2ta_05rJok33Vt_W56Uy67XN2o3CzYaWf9M2FY5gRjYL38pmM3NE41bMTpTKfGPYffQZjw2tWsTZVBmGVoPBx5_E86Jsx7Bu0do Aug 09 18:15:27.011553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:15:27.011553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:15:27.011553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:15:27.011553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:15:27.011553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:15:27.011553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:15:27.011553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: e9b71c6efb004375985eabcb2dd3678e Aug 09 18:15:27.011553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-VolumesGetTestJSON-1236755487 Aug 09 18:15:27.011553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:15:27.011553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:15:27.020270 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e9b71c6efb004375985eabcb2dd3678e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e9b71c6efb004375985eabcb2dd3678e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e9b71c6efb004375985eabcb2dd3678e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e9b71c6efb004375985eabcb2dd3678e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:15:27.020270 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-VolumesGetTestJSON-1236755487 Aug 09 18:15:27.020270 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: e9b71c6efb004375985eabcb2dd3678e Aug 09 18:15:27.020270 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-VolumesGetTestJSON-1236755487 Aug 09 18:15:27.020270 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-VolumesGetTestJSON-1236755487-project Aug 09 18:15:27.020270 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:15:27.020270 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:15:27.020270 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: 7ec9c7e425784cc2af0b9c4f47463a87 Aug 09 18:15:27.020270 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-VolumesGetTestJSON-1236755487-project Aug 09 18:15:27.020270 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: Aug 09 18:15:27.020270 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Volume 8ded4e95-09ec-416f-a750-282c417bd7de could not be found. Aug 09 18:15:27.020270 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': '8ded4e95-09ec-416f-a750-282c417bd7de'} Aug 09 18:15:27.020270 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:15:27.023041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:27.023041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:15:27.023041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:15:27.023041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 18:15:27.023041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 18:15:27.023041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 18:15:27.023041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 18:15:27.023041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:15:27.023041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:15:27.023041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:15:27.023041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:15:27.023041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:15:27.023041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:15:27.023041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:15:27.023041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:15:27.023041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8ded4e95-09ec-416f-a750-282c417bd7de could not be found. (HTTP 404) (Request-ID: req-ac75b187-0237-4385-b540-dca7055285d2) Aug 09 18:15:27.023041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:27.023041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:27.023041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:27.025280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:27.025280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 18:15:27.025280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 18:15:27.025280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 18:15:27.025280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 18:15:27.025280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 18:15:27.025280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 18:15:27.025280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 18:15:27.025280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 18:15:27.025280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:15:27.025280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:15:27.025280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 18:15:27.025280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 18:15:27.025280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 18:15:27.025280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 18:15:27.025280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:15:27.025280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:15:27.025280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:15:27.025280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:15:27.027045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:15:27.027045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:15:27.027045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:15:27.027045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:15:27.027045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8ded4e95-09ec-416f-a750-282c417bd7de could not be found. Aug 09 18:15:27.027045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:27.027045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:27.027045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:27.027045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:27.027045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:15:27.027045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:15:27.027045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:15:27.027045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:15:27.027045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:15:27.027045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:15:27.027045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:15:27.027045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:15:27.027045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 18:15:27.027045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:15:27.029352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8ded4e95-09ec-416f-a750-282c417bd7de could not be found. Aug 09 18:15:27.029352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:27.029352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:27.029352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:27.029352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:27.029352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:15:27.029352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:15:27.029352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:15:27.029352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:15:27.029352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8ded4e95-09ec-416f-a750-282c417bd7de could not be found. Aug 09 18:15:27.029352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:27.029352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-1f92f0de-4408-43cb-9643-c3647b49ae23 tempest-VolumesGetTestJSON-1236755487 tempest-VolumesGetTestJSON-1236755487-project] Returning 404 to user: Volume 8ded4e95-09ec-416f-a750-282c417bd7de could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:15:27.029352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-1f92f0de-4408-43cb-9643-c3647b49ae23 tempest-VolumesGetTestJSON-1236755487 tempest-VolumesGetTestJSON-1236755487-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/8ded4e95-09ec-416f-a750-282c417bd7de" status: 404 len: 109 microversion: 2.1 time: 0.630107 Aug 09 18:15:27.029352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 4/9] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Aug 9 18:15:26 2022] GET /compute/v2.1/os-volumes/8ded4e95-09ec-416f-a750-282c417bd7de => generated 109 bytes in 631 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:15:28.052033 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f8fb7244-1bdf-4a1b-993f-822a2b3684bb tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.391399 Aug 09 18:15:28.052882 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 6/10] 10.222.0.36 () {60 vars in 1162 bytes} [Tue Aug 9 18:15:26 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:15:28.064249 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6140ce49-435d-46a1-ab8e-a552ca3501aa tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Calling method '.version_select at 0x7f4c3713f4c0>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:28.171156 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-6140ce49-435d-46a1-ab8e-a552ca3501aa tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/cef23255-f048-4bcd-a479-1d0b97a7ca95" status: 200 len: 287 microversion: 2.1 time: 0.110728 Aug 09 18:15:28.177300 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 5/11] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Aug 9 18:15:28 2022] GET /compute/v2.1/os-snapshots/cef23255-f048-4bcd-a479-1d0b97a7ca95 => generated 287 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:15:28.184855 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c8828031-b324-45b6-8944-aefdc6c76fed tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Calling method '.version_select at 0x7f4c371dc4c0>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:28.461764 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c8828031-b324-45b6-8944-aefdc6c76fed tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.282811 Aug 09 18:15:28.462741 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 7/12] 10.222.0.36 () {58 vars in 1140 bytes} [Tue Aug 9 18:15:28 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:15:28.477973 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c80425c5-e872-4894-8cae-eda6bfe92aef tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Calling method '.version_select at 0x7f4c37346d30>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:28.770204 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-c80425c5-e872-4894-8cae-eda6bfe92aef tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/cef23255-f048-4bcd-a479-1d0b97a7ca95" status: 200 len: 287 microversion: 2.1 time: 0.297721 Aug 09 18:15:28.776897 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 6/13] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Aug 9 18:15:28 2022] GET /compute/v2.1/os-snapshots/cef23255-f048-4bcd-a479-1d0b97a7ca95 => generated 287 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:15:29.781594 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d69310d9-c13f-41ba-831c-466217f8ac6e tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Calling method '.version_select at 0x7f4c371dc9d0>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:29.828600 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d69310d9-c13f-41ba-831c-466217f8ac6e tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/cef23255-f048-4bcd-a479-1d0b97a7ca95" status: 200 len: 287 microversion: 2.1 time: 0.050526 Aug 09 18:15:29.834758 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 8/14] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Aug 9 18:15:29 2022] GET /compute/v2.1/os-snapshots/cef23255-f048-4bcd-a479-1d0b97a7ca95 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:15:30.844508 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6b3c0650-0a8c-4e3d-8a84-d493d65b5995 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Calling method '.version_select at 0x7f4c3713f3a0>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:30.908257 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-6b3c0650-0a8c-4e3d-8a84-d493d65b5995 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/cef23255-f048-4bcd-a479-1d0b97a7ca95" status: 200 len: 287 microversion: 2.1 time: 0.070617 Aug 09 18:15:30.908991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 7/15] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Aug 9 18:15:30 2022] GET /compute/v2.1/os-snapshots/cef23255-f048-4bcd-a479-1d0b97a7ca95 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:15:31.923640 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-35810966-e01d-471f-bb19-934f7abebf44 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Calling method '.version_select at 0x7f4c371dc0d0>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:31.991807 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-35810966-e01d-471f-bb19-934f7abebf44 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/cef23255-f048-4bcd-a479-1d0b97a7ca95" status: 200 len: 287 microversion: 2.1 time: 0.073988 Aug 09 18:15:32.000041 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 9/16] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Aug 9 18:15:31 2022] GET /compute/v2.1/os-snapshots/cef23255-f048-4bcd-a479-1d0b97a7ca95 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:15:33.012341 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-919a570e-84ab-4dd7-bfc9-9daa528d429b tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Calling method '.version_select at 0x7f4c3713fdc0>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:33.078610 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-919a570e-84ab-4dd7-bfc9-9daa528d429b tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/cef23255-f048-4bcd-a479-1d0b97a7ca95" status: 200 len: 287 microversion: 2.1 time: 0.070161 Aug 09 18:15:33.083832 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 8/17] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Aug 9 18:15:33 2022] GET /compute/v2.1/os-snapshots/cef23255-f048-4bcd-a479-1d0b97a7ca95 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:15:34.095360 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-269b942f-c4d5-47a9-a9ce-37023ef62d98 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Calling method '.version_select at 0x7f4c371d3310>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:34.196365 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-269b942f-c4d5-47a9-a9ce-37023ef62d98 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/cef23255-f048-4bcd-a479-1d0b97a7ca95" status: 200 len: 287 microversion: 2.1 time: 0.107448 Aug 09 18:15:34.197333 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 10/18] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Aug 9 18:15:34 2022] GET /compute/v2.1/os-snapshots/cef23255-f048-4bcd-a479-1d0b97a7ca95 => generated 287 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:15:35.210399 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e0e51fb1-6fe8-47b5-95b0-da47aa1c046b tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Calling method '.version_select at 0x7f4c371d3940>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:35.258820 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-ae83c7ea-d710-49dd-9095-23a739af7286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-377982821", "imageRef": "53732c26-c942-4646-ac3f-8d9e11ab4d57", "flavorRef": "452", "networks": [{"uuid": "0200f778-2f47-426c-bc3b-e72d140e990d"}]}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:15:35.439452 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e0e51fb1-6fe8-47b5-95b0-da47aa1c046b tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/cef23255-f048-4bcd-a479-1d0b97a7ca95" status: 200 len: 288 microversion: 2.1 time: 0.233502 Aug 09 18:15:35.443244 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 11/19] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Aug 9 18:15:35 2022] GET /compute/v2.1/os-snapshots/cef23255-f048-4bcd-a479-1d0b97a7ca95 => generated 288 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:15:35.466488 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-7aa394f2-4e52-426b-a7fd-fc787bf320ae tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Calling method '.version_select at 0x7f4c371dcee0>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:35.471797 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.network.neutron [None req-ae83c7ea-d710-49dd-9095-23a739af7286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] validate_networks() for [('0200f778-2f47-426c-bc3b-e72d140e990d', None, None, None, None, None)] {{(pid=118313) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:15:35.796889 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-7aa394f2-4e52-426b-a7fd-fc787bf320ae tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/cef23255-f048-4bcd-a479-1d0b97a7ca95" status: 202 len: 0 microversion: 2.1 time: 0.346140 Aug 09 18:15:35.798296 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 12/20] 10.222.0.36 () {58 vars in 1254 bytes} [Tue Aug 9 18:15:35 2022] DELETE /compute/v2.1/os-snapshots/cef23255-f048-4bcd-a479-1d0b97a7ca95 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:15:36.290052 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-cc9cc2b5-874b-450a-9e8e-5ebed4cd4cd4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Action: 'create', calling method: .version_select at 0x7f4c371dc8b0>, body: {"keypair": {"name": "tempest-keypair-1826225726", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdP06tvgHLGYe+bjZzLOjqnEzKM6ho/g6qRCZ1gtXx6lmW9xFptSKtb759Xfu/QIMXffheQHgy6an7H+VLGMTne0AretTm8ca2qZa53MRLTcOdKD2wz8bYNg4yhNwUICw=="}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:15:36.421309 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-cc9cc2b5-874b-450a-9e8e-5ebed4cd4cd4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Getting quotas for project ac2e5c4bafff4b16bb9d82dacb5dd056. Resources: {'key_pairs'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:15:36.446548 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-cc9cc2b5-874b-450a-9e8e-5ebed4cd4cd4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Getting quotas for user 528811040ede40bdb40e3e6e666d283d and project ac2e5c4bafff4b16bb9d82dacb5dd056. Resources: {'key_pairs'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:15:36.701053 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-cc9cc2b5-874b-450a-9e8e-5ebed4cd4cd4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.895364 Aug 09 18:15:36.701053 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 13/21] 10.222.0.36 () {62 vars in 1200 bytes} [Tue Aug 9 18:15:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 898 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 18:15:36.709394 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c0d015a7-dcac-444c-b728-d4e92cb8350d tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Calling method '.version_select at 0x7f4c36959310>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:36.892768 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-c0d015a7-dcac-444c-b728-d4e92cb8350d tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] HTTP exception thrown: Snapshot cef23255-f048-4bcd-a479-1d0b97a7ca95 could not be found. Aug 09 18:15:36.896977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c0d015a7-dcac-444c-b728-d4e92cb8350d tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Request method failure captured: Aug 09 18:15:36.896977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: GET /compute/v2.1/os-snapshots/cef23255-f048-4bcd-a479-1d0b97a7ca95 HTTP/1.1 Aug 09 18:15:36.896977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:15:36.896977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:15:36.896977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:15:36.896977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 0 Aug 09 18:15:36.896977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:15:36.896977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:15:36.896977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:15:36.896977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:15:36.896977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qQ44gWNX3jj5ePM4uvlTJJHBnqwur-D1wnHxQvj8oK06IpFhMnk4xBJyCrL_IJkLuXUlTxq2K6trr74oDpfhuNcrSBalsBouPHhuXaA3vu8X2KT9iEwxgo4deIrcYVkAlGJbzMinN9TLr0HUCIA70mCa3yPsMyL4HPlXBRpGBNRXqg Aug 09 18:15:36.896977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:15:36.896977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:15:36.896977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:15:36.896977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:15:36.896977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:15:36.896977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:15:36.896977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: aa4976a9e83745b1851277848cc99c37 Aug 09 18:15:36.896977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-694770793 Aug 09 18:15:36.896977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:15:36.896977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:15:36.898523 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aa4976a9e83745b1851277848cc99c37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/aa4976a9e83745b1851277848cc99c37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_aa4976a9e83745b1851277848cc99c37", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aa4976a9e83745b1851277848cc99c37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:15:36.898523 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-VolumesSnapshotsTestJSON-694770793 Aug 09 18:15:36.898523 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: aa4976a9e83745b1851277848cc99c37 Aug 09 18:15:36.898523 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-694770793 Aug 09 18:15:36.898523 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-VolumesSnapshotsTestJSON-694770793-project Aug 09 18:15:36.898523 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:15:36.898523 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:15:36.898523 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: 7569e6a68c9d40709954daf6a5e40c08 Aug 09 18:15:36.898523 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-VolumesSnapshotsTestJSON-694770793-project Aug 09 18:15:36.898523 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: Aug 09 18:15:36.898523 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Snapshot cef23255-f048-4bcd-a479-1d0b97a7ca95 could not be found. Aug 09 18:15:36.898523 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'id': 'cef23255-f048-4bcd-a479-1d0b97a7ca95'} Aug 09 18:15:36.898523 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:15:36.899316 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:36.899316 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 18:15:36.899316 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 18:15:36.899316 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 18:15:36.899316 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 18:15:36.899316 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 18:15:36.899316 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 18:15:36.899316 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:15:36.899316 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:15:36.899316 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:15:36.899316 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:15:36.899316 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:15:36.899316 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:15:36.899316 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:15:36.899316 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:15:36.899316 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot cef23255-f048-4bcd-a479-1d0b97a7ca95 could not be found. (HTTP 404) (Request-ID: req-beeadac7-dfcd-4b1c-badb-817e7e4c6707) Aug 09 18:15:36.899316 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:15:36.899316 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:36.900285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:15:36.900285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:36.900285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 09 18:15:36.900285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 09 18:15:36.900285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 18:15:36.900285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 18:15:36.900285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 09 18:15:36.900285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 09 18:15:36.900285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 18:15:36.900285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 18:15:36.900285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 18:15:36.900285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 18:15:36.900285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 18:15:36.900285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 18:15:36.900285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 18:15:36.900285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 18:15:36.900285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:15:36.900285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:15:36.900285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:15:36.901261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:15:36.901261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:15:36.901261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:15:36.901261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:15:36.901261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:15:36.901261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot cef23255-f048-4bcd-a479-1d0b97a7ca95 could not be found. Aug 09 18:15:36.901261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:15:36.901261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:36.901261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:15:36.901261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:36.901261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:15:36.901261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:15:36.901261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:15:36.901261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:15:36.901261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:15:36.901261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:15:36.901261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:15:36.901261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:15:36.901261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 09 18:15:36.901261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:15:36.902183 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot cef23255-f048-4bcd-a479-1d0b97a7ca95 could not be found. Aug 09 18:15:36.902183 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:15:36.902183 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:36.902183 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:15:36.902183 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:36.902183 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:15:36.902183 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:15:36.902183 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:15:36.902183 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:15:36.902183 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot cef23255-f048-4bcd-a479-1d0b97a7ca95 could not be found. Aug 09 18:15:36.902183 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:15:36.902183 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c0d015a7-dcac-444c-b728-d4e92cb8350d tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Returning 404 to user: Snapshot cef23255-f048-4bcd-a479-1d0b97a7ca95 could not be found. {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:15:36.902183 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c0d015a7-dcac-444c-b728-d4e92cb8350d tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/cef23255-f048-4bcd-a479-1d0b97a7ca95" status: 404 len: 111 microversion: 2.1 time: 0.200445 Aug 09 18:15:36.902183 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 14/22] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Aug 9 18:15:36 2022] GET /compute/v2.1/os-snapshots/cef23255-f048-4bcd-a479-1d0b97a7ca95 => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:15:36.918070 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-9d004c2c-1785-4ff7-b28d-e03676ea3422 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Calling method '.version_select at 0x7f4c369358b0>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:37.235429 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-9d004c2c-1785-4ff7-b28d-e03676ea3422 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/ae51ae62-dad0-47cb-a12d-6ebca32ddc40" status: 202 len: 0 microversion: 2.1 time: 0.331636 Aug 09 18:15:37.241095 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 15/23] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Aug 9 18:15:36 2022] DELETE /compute/v2.1/os-volumes/ae51ae62-dad0-47cb-a12d-6ebca32ddc40 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:15:37.241205 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-ae83c7ea-d710-49dd-9095-23a739af7286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Flavor limits 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:15:37.241699 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-ae83c7ea-d710-49dd-9095-23a739af7286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Image limits 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:15:37.242160 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-ae83c7ea-d710-49dd-9095-23a739af7286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Flavor pref 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:15:37.242759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-ae83c7ea-d710-49dd-9095-23a739af7286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Image pref 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:15:37.245395 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-ae83c7ea-d710-49dd-9095-23a739af7286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:15:37.251582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-253b888d-52ad-453e-986a-0ee85eec222a tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Calling method '.version_select at 0x7f4c369353a0>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:37.277338 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ae83c7ea-d710-49dd-9095-23a739af7286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:37.278289 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ae83c7ea-d710-49dd-9095-23a739af7286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:37.279000 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ae83c7ea-d710-49dd-9095-23a739af7286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:37.280016 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ae83c7ea-d710-49dd-9095-23a739af7286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:37.280699 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ae83c7ea-d710-49dd-9095-23a739af7286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:37.281328 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ae83c7ea-d710-49dd-9095-23a739af7286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:37.330528 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-ae83c7ea-d710-49dd-9095-23a739af7286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Getting quotas for project ad80b76c328d44aa9479a98367f0f65c. Resources: {'cores', 'instances', 'ram'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:15:37.338960 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-ae83c7ea-d710-49dd-9095-23a739af7286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Getting quotas for user 5f405a8b7cd64c7e9615a528a0d2484b and project ad80b76c328d44aa9479a98367f0f65c. Resources: {'cores', 'instances', 'ram'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:15:37.358670 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-ae83c7ea-d710-49dd-9095-23a739af7286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Going to run 1 instances... {{(pid=118313) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:15:37.365073 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-ae83c7ea-d710-49dd-9095-23a739af7286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53732c26-c942-4646-ac3f-8d9e11ab4d57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118313) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:15:37.408750 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-253b888d-52ad-453e-986a-0ee85eec222a tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/ae51ae62-dad0-47cb-a12d-6ebca32ddc40" status: 200 len: 345 microversion: 2.1 time: 0.160765 Aug 09 18:15:37.409426 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 16/24] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Aug 9 18:15:37 2022] GET /compute/v2.1/os-volumes/ae51ae62-dad0-47cb-a12d-6ebca32ddc40 => generated 345 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:15:37.604701 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-ae83c7ea-d710-49dd-9095-23a739af7286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.742325 Aug 09 18:15:37.607539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 9/25] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Aug 9 18:15:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:15:37.633968 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a2f47b01-0827-451d-b5a7-2fd5bc1bba10 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:37.634604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a2f47b01-0827-451d-b5a7-2fd5bc1bba10 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:37.847721 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a2f47b01-0827-451d-b5a7-2fd5bc1bba10 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:37.852815 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d562b8cb-4862-4b09-b924-412cae1ed258 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-36017443", "imageRef": "53732c26-c942-4646-ac3f-8d9e11ab4d57", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:15:37.872765 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a2f47b01-0827-451d-b5a7-2fd5bc1bba10 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1214 microversion: 2.1 time: 0.254308 Aug 09 18:15:37.875566 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 10/26] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:37 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1214 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:15:37.970522 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.network.neutron [None req-d562b8cb-4862-4b09-b924-412cae1ed258 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] validate_networks() for [('03ed61e4-08cc-4115-8e7b-4a7bf5a548a8', None, None, None, None, None)] {{(pid=118314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:15:38.427902 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-75dfc851-cabf-4dd9-a675-13eb9cb52174 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Calling method '.version_select at 0x7f4c36850700>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:38.535419 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-75dfc851-cabf-4dd9-a675-13eb9cb52174 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/ae51ae62-dad0-47cb-a12d-6ebca32ddc40" status: 200 len: 345 microversion: 2.1 time: 0.112060 Aug 09 18:15:38.536306 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 11/27] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Aug 9 18:15:38 2022] GET /compute/v2.1/os-volumes/ae51ae62-dad0-47cb-a12d-6ebca32ddc40 => generated 345 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:15:38.898005 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-8adefa89-6231-4a35-b48a-6e8d8e5afd2c tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:38.901544 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-8adefa89-6231-4a35-b48a-6e8d8e5afd2c tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:39.066326 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-8adefa89-6231-4a35-b48a-6e8d8e5afd2c tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:39.084028 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-8adefa89-6231-4a35-b48a-6e8d8e5afd2c tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1214 microversion: 2.1 time: 0.188860 Aug 09 18:15:39.084902 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 12/28] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:38 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1214 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:15:39.348565 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-d562b8cb-4862-4b09-b924-412cae1ed258 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Flavor limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:15:39.349319 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-d562b8cb-4862-4b09-b924-412cae1ed258 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Image limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:15:39.349540 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-d562b8cb-4862-4b09-b924-412cae1ed258 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Flavor pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:15:39.350135 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-d562b8cb-4862-4b09-b924-412cae1ed258 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Image pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:15:39.350727 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-d562b8cb-4862-4b09-b924-412cae1ed258 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:15:39.380683 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d562b8cb-4862-4b09-b924-412cae1ed258 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:39.380683 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d562b8cb-4862-4b09-b924-412cae1ed258 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:39.380683 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d562b8cb-4862-4b09-b924-412cae1ed258 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:39.398897 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d562b8cb-4862-4b09-b924-412cae1ed258 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:39.399398 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d562b8cb-4862-4b09-b924-412cae1ed258 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:39.399838 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d562b8cb-4862-4b09-b924-412cae1ed258 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:39.490782 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-d562b8cb-4862-4b09-b924-412cae1ed258 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Getting quotas for project dbd7e50444cc4ef0873bfac9d9a2d514. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:15:39.501461 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-d562b8cb-4862-4b09-b924-412cae1ed258 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Getting quotas for user 18fae6990e4148ff97dec28b204c52df and project dbd7e50444cc4ef0873bfac9d9a2d514. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:15:39.522301 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d562b8cb-4862-4b09-b924-412cae1ed258 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Going to run 1 instances... {{(pid=118314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:15:39.525458 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d562b8cb-4862-4b09-b924-412cae1ed258 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53732c26-c942-4646-ac3f-8d9e11ab4d57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:15:39.551362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-998ccbe1-093c-4192-989b-8f8b56119173 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Calling method '.version_select at 0x7f4c36872af0>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:39.680140 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-998ccbe1-093c-4192-989b-8f8b56119173 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/ae51ae62-dad0-47cb-a12d-6ebca32ddc40" status: 200 len: 345 microversion: 2.1 time: 0.134061 Aug 09 18:15:39.680779 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 13/29] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Aug 9 18:15:39 2022] GET /compute/v2.1/os-volumes/ae51ae62-dad0-47cb-a12d-6ebca32ddc40 => generated 345 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:15:39.816342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d562b8cb-4862-4b09-b924-412cae1ed258 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.405608 Aug 09 18:15:39.818081 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 17/30] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Aug 9 18:15:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 2408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:15:39.830593 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-514055fe-43a8-4e5c-82b4-317526a55f19 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:39.831249 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-514055fe-43a8-4e5c-82b4-317526a55f19 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:39.980854 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-514055fe-43a8-4e5c-82b4-317526a55f19 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:39.993593 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-514055fe-43a8-4e5c-82b4-317526a55f19 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1220 microversion: 2.1 time: 0.166888 Aug 09 18:15:39.996399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 14/31] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:39 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1220 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:15:40.109151 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-816f218b-bec6-449a-bc46-c959190eca98 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:40.109800 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-816f218b-bec6-449a-bc46-c959190eca98 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:40.253648 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9215af59-bdb6-434a-857a-ec3cce9ca657 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-989050920", "imageRef": "53732c26-c942-4646-ac3f-8d9e11ab4d57", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:15:40.284589 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-816f218b-bec6-449a-bc46-c959190eca98 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:40.307554 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-816f218b-bec6-449a-bc46-c959190eca98 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1214 microversion: 2.1 time: 0.204660 Aug 09 18:15:40.338601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 18/32] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:40 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1214 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:15:40.383555 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.network.neutron [None req-9215af59-bdb6-434a-857a-ec3cce9ca657 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] validate_networks() for [('03ed61e4-08cc-4115-8e7b-4a7bf5a548a8', None, None, None, None, None)] {{(pid=118313) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:15:40.696033 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-3cdcca70-5cd1-4a2c-9fb2-0a962b4499af tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Calling method '.version_select at 0x7f4c35806e50>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:40.872650 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-3cdcca70-5cd1-4a2c-9fb2-0a962b4499af tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/ae51ae62-dad0-47cb-a12d-6ebca32ddc40" status: 200 len: 345 microversion: 2.1 time: 0.182869 Aug 09 18:15:40.873432 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 19/33] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Aug 9 18:15:40 2022] GET /compute/v2.1/os-volumes/ae51ae62-dad0-47cb-a12d-6ebca32ddc40 => generated 345 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:15:41.245078 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-9215af59-bdb6-434a-857a-ec3cce9ca657 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Flavor limits 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:15:41.250021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-9215af59-bdb6-434a-857a-ec3cce9ca657 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Image limits 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:15:41.251678 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-9215af59-bdb6-434a-857a-ec3cce9ca657 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Flavor pref 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:15:41.253052 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-9215af59-bdb6-434a-857a-ec3cce9ca657 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Image pref 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:15:41.254595 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-9215af59-bdb6-434a-857a-ec3cce9ca657 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:15:41.300475 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9215af59-bdb6-434a-857a-ec3cce9ca657 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:41.302277 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9215af59-bdb6-434a-857a-ec3cce9ca657 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:41.304508 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9215af59-bdb6-434a-857a-ec3cce9ca657 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:41.305312 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9215af59-bdb6-434a-857a-ec3cce9ca657 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:41.305782 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9215af59-bdb6-434a-857a-ec3cce9ca657 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:41.306209 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9215af59-bdb6-434a-857a-ec3cce9ca657 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:41.363167 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-63032b13-477f-41ff-96ae-e753a0291e6e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:41.364707 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-63032b13-477f-41ff-96ae-e753a0291e6e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:41.377770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-9215af59-bdb6-434a-857a-ec3cce9ca657 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Getting quotas for project dbd7e50444cc4ef0873bfac9d9a2d514. Resources: {'cores', 'instances', 'ram'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:15:41.381691 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-63032b13-477f-41ff-96ae-e753a0291e6e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:41.383734 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-63032b13-477f-41ff-96ae-e753a0291e6e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:41.383734 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-63032b13-477f-41ff-96ae-e753a0291e6e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:41.383734 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-63032b13-477f-41ff-96ae-e753a0291e6e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:41.387253 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-63032b13-477f-41ff-96ae-e753a0291e6e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:41.390207 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-63032b13-477f-41ff-96ae-e753a0291e6e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:41.391479 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-9215af59-bdb6-434a-857a-ec3cce9ca657 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Getting quotas for user 18fae6990e4148ff97dec28b204c52df and project dbd7e50444cc4ef0873bfac9d9a2d514. Resources: {'cores', 'instances', 'ram'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:15:41.421431 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9215af59-bdb6-434a-857a-ec3cce9ca657 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Going to run 1 instances... {{(pid=118313) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:15:41.424349 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9215af59-bdb6-434a-857a-ec3cce9ca657 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53732c26-c942-4646-ac3f-8d9e11ab4d57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118313) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:15:41.620086 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-63032b13-477f-41ff-96ae-e753a0291e6e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:41.621543 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9215af59-bdb6-434a-857a-ec3cce9ca657 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.373406 Aug 09 18:15:41.622836 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 15/34] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Aug 9 18:15:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 1376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:15:41.634447 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d4af3cac-8d54-4737-a9c1-9b188cb94695 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:41.635307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d4af3cac-8d54-4737-a9c1-9b188cb94695 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:41.649738 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-63032b13-477f-41ff-96ae-e753a0291e6e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1218 microversion: 2.1 time: 0.292040 Aug 09 18:15:41.656237 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 20/35] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:41 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1218 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:15:41.691979 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-38ed64cf-cc00-4820-a8a1-7117d4061194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1025721886", "imageRef": "53732c26-c942-4646-ac3f-8d9e11ab4d57", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41cec70a-6176-4317-97fd-9218f52e1ff9"}], "security_groups": [{"name": "tempest-securitygroup--1477605514"}], "key_name": "tempest-keypair-1826225726", "user_data": "}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:15:41.795481 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d4af3cac-8d54-4737-a9c1-9b188cb94695 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:41.807042 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d4af3cac-8d54-4737-a9c1-9b188cb94695 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1221 microversion: 2.1 time: 0.177452 Aug 09 18:15:41.815475 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 16/36] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:41 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1221 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:15:41.889804 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-45eeb924-f8c9-407e-bb83-2c77534a3e94 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Calling method '.version_select at 0x7f4c35ffe1f0>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:42.008858 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.network.neutron [None req-38ed64cf-cc00-4820-a8a1-7117d4061194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] validate_networks() for [('41cec70a-6176-4317-97fd-9218f52e1ff9', None, None, None, None, None)] {{(pid=118314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:15:42.021886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-45eeb924-f8c9-407e-bb83-2c77534a3e94 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] HTTP exception thrown: Volume ae51ae62-dad0-47cb-a12d-6ebca32ddc40 could not be found. Aug 09 18:15:42.021886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-45eeb924-f8c9-407e-bb83-2c77534a3e94 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Request method failure captured: Aug 09 18:15:42.021886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: GET /compute/v2.1/os-volumes/ae51ae62-dad0-47cb-a12d-6ebca32ddc40 HTTP/1.1 Aug 09 18:15:42.021886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:15:42.021886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:15:42.021886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:15:42.021886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:15:42.021886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:15:42.021886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:15:42.021886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:15:42.021886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:15:42.021886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qQ44gWNX3jj5ePM4uvlTJJHBnqwur-D1wnHxQvj8oK06IpFhMnk4xBJyCrL_IJkLuXUlTxq2K6trr74oDpfhuNcrSBalsBouPHhuXaA3vu8X2KT9iEwxgo4deIrcYVkAlGJbzMinN9TLr0HUCIA70mCa3yPsMyL4HPlXBRpGBNRXqg Aug 09 18:15:42.021886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:15:42.021886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:15:42.021886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:15:42.021886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:15:42.021886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:15:42.021886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:15:42.021886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: aa4976a9e83745b1851277848cc99c37 Aug 09 18:15:42.021886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-694770793 Aug 09 18:15:42.021886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:15:42.021886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:15:42.023702 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aa4976a9e83745b1851277848cc99c37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/aa4976a9e83745b1851277848cc99c37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_aa4976a9e83745b1851277848cc99c37", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aa4976a9e83745b1851277848cc99c37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:15:42.023702 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-VolumesSnapshotsTestJSON-694770793 Aug 09 18:15:42.023702 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: aa4976a9e83745b1851277848cc99c37 Aug 09 18:15:42.023702 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-694770793 Aug 09 18:15:42.023702 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-VolumesSnapshotsTestJSON-694770793-project Aug 09 18:15:42.023702 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:15:42.023702 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:15:42.023702 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: 7569e6a68c9d40709954daf6a5e40c08 Aug 09 18:15:42.023702 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-VolumesSnapshotsTestJSON-694770793-project Aug 09 18:15:42.023702 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: Aug 09 18:15:42.023702 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Volume ae51ae62-dad0-47cb-a12d-6ebca32ddc40 could not be found. Aug 09 18:15:42.023702 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': 'ae51ae62-dad0-47cb-a12d-6ebca32ddc40'} Aug 09 18:15:42.023702 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:15:42.024552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:42.024552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:15:42.024552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:15:42.024552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 18:15:42.024552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 18:15:42.024552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 18:15:42.024552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 18:15:42.024552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:15:42.024552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:15:42.024552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:15:42.024552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:15:42.024552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:15:42.024552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:15:42.024552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:15:42.024552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:15:42.024552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ae51ae62-dad0-47cb-a12d-6ebca32ddc40 could not be found. (HTTP 404) (Request-ID: req-bf0e2993-837b-4c43-b0db-391f7d246d94) Aug 09 18:15:42.024552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:42.024552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:42.024552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:42.025718 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:42.025718 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 18:15:42.025718 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 18:15:42.025718 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 18:15:42.025718 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 18:15:42.025718 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 18:15:42.025718 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 18:15:42.025718 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 18:15:42.025718 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 18:15:42.025718 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:15:42.025718 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:15:42.025718 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 18:15:42.025718 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 18:15:42.025718 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 18:15:42.025718 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 18:15:42.025718 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:15:42.025718 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:15:42.025718 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:15:42.025718 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:15:42.027019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:15:42.027019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:15:42.027019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:15:42.027019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:15:42.027019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ae51ae62-dad0-47cb-a12d-6ebca32ddc40 could not be found. Aug 09 18:15:42.027019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:42.027019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:42.027019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:42.027019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:42.027019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:15:42.027019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:15:42.027019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:15:42.027019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:15:42.027019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:15:42.027019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:15:42.027019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:15:42.027019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:15:42.027019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 18:15:42.027019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:15:42.028327 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ae51ae62-dad0-47cb-a12d-6ebca32ddc40 could not be found. Aug 09 18:15:42.028327 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:42.028327 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:42.028327 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:42.028327 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:42.028327 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:15:42.028327 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:15:42.028327 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:15:42.028327 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:15:42.028327 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ae51ae62-dad0-47cb-a12d-6ebca32ddc40 could not be found. Aug 09 18:15:42.028327 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:42.028327 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-45eeb924-f8c9-407e-bb83-2c77534a3e94 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Returning 404 to user: Volume ae51ae62-dad0-47cb-a12d-6ebca32ddc40 could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:15:42.028327 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-45eeb924-f8c9-407e-bb83-2c77534a3e94 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/ae51ae62-dad0-47cb-a12d-6ebca32ddc40" status: 404 len: 109 microversion: 2.1 time: 0.128487 Aug 09 18:15:42.028327 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 17/37] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Aug 9 18:15:41 2022] GET /compute/v2.1/os-volumes/ae51ae62-dad0-47cb-a12d-6ebca32ddc40 => generated 109 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:15:42.058479 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6d7a5417-ebee-4d5a-a6ae-a72373663f50 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Calling method '.version_select at 0x7f4c3600c1f0>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:42.128115 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-6d7a5417-ebee-4d5a-a6ae-a72373663f50 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] HTTP exception thrown: Volume ae51ae62-dad0-47cb-a12d-6ebca32ddc40 could not be found. Aug 09 18:15:42.131878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6d7a5417-ebee-4d5a-a6ae-a72373663f50 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Request method failure captured: Aug 09 18:15:42.131878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: DELETE /compute/v2.1/os-volumes/ae51ae62-dad0-47cb-a12d-6ebca32ddc40 HTTP/1.1 Aug 09 18:15:42.131878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:15:42.131878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:15:42.131878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:15:42.131878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:15:42.131878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:15:42.131878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:15:42.131878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:15:42.131878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:15:42.131878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qQ44gWNX3jj5ePM4uvlTJJHBnqwur-D1wnHxQvj8oK06IpFhMnk4xBJyCrL_IJkLuXUlTxq2K6trr74oDpfhuNcrSBalsBouPHhuXaA3vu8X2KT9iEwxgo4deIrcYVkAlGJbzMinN9TLr0HUCIA70mCa3yPsMyL4HPlXBRpGBNRXqg Aug 09 18:15:42.131878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:15:42.131878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:15:42.131878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:15:42.131878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:15:42.131878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:15:42.131878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:15:42.131878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: aa4976a9e83745b1851277848cc99c37 Aug 09 18:15:42.131878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-694770793 Aug 09 18:15:42.131878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:15:42.131878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:15:42.137713 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aa4976a9e83745b1851277848cc99c37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/aa4976a9e83745b1851277848cc99c37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_aa4976a9e83745b1851277848cc99c37", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aa4976a9e83745b1851277848cc99c37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:15:42.137713 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-VolumesSnapshotsTestJSON-694770793 Aug 09 18:15:42.137713 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: aa4976a9e83745b1851277848cc99c37 Aug 09 18:15:42.137713 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-694770793 Aug 09 18:15:42.137713 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-VolumesSnapshotsTestJSON-694770793-project Aug 09 18:15:42.137713 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:15:42.137713 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:15:42.137713 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: 7569e6a68c9d40709954daf6a5e40c08 Aug 09 18:15:42.137713 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-VolumesSnapshotsTestJSON-694770793-project Aug 09 18:15:42.137713 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: Aug 09 18:15:42.137713 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Volume ae51ae62-dad0-47cb-a12d-6ebca32ddc40 could not be found. Aug 09 18:15:42.137713 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': 'ae51ae62-dad0-47cb-a12d-6ebca32ddc40'} Aug 09 18:15:42.137713 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:15:42.138423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:42.138423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:15:42.138423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:15:42.138423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 18:15:42.138423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 18:15:42.138423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 18:15:42.138423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 18:15:42.138423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 18:15:42.138423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 18:15:42.138423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 18:15:42.138423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 18:15:42.138423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:15:42.138423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:15:42.138423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:15:42.138423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:15:42.138423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ae51ae62-dad0-47cb-a12d-6ebca32ddc40 could not be found. (HTTP 404) (Request-ID: req-a81d9d6e-594f-4ca7-bdf8-13405223fb0c) Aug 09 18:15:42.138423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:42.138423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:42.138423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:42.139404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:42.139404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 18:15:42.139404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 18:15:42.139404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 18:15:42.139404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 18:15:42.139404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 18:15:42.139404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 18:15:42.139404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 18:15:42.139404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 18:15:42.139404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:15:42.139404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:15:42.139404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 18:15:42.139404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 18:15:42.139404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 18:15:42.139404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 18:15:42.139404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 18:15:42.139404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 18:15:42.139404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 18:15:42.139404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 18:15:42.142412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:15:42.142412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:15:42.142412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:15:42.142412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:15:42.142412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ae51ae62-dad0-47cb-a12d-6ebca32ddc40 could not be found. Aug 09 18:15:42.142412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:42.142412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:42.142412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:42.142412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:42.142412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:15:42.142412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:15:42.142412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:15:42.142412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:15:42.142412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:15:42.142412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:15:42.142412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:15:42.142412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:15:42.142412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 18:15:42.142412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:15:42.145707 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ae51ae62-dad0-47cb-a12d-6ebca32ddc40 could not be found. Aug 09 18:15:42.145707 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:42.145707 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:42.145707 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:42.145707 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:42.145707 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:15:42.145707 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:15:42.145707 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:15:42.145707 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:15:42.145707 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ae51ae62-dad0-47cb-a12d-6ebca32ddc40 could not be found. Aug 09 18:15:42.145707 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:42.145707 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6d7a5417-ebee-4d5a-a6ae-a72373663f50 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Returning 404 to user: Volume ae51ae62-dad0-47cb-a12d-6ebca32ddc40 could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:15:42.145707 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-6d7a5417-ebee-4d5a-a6ae-a72373663f50 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/ae51ae62-dad0-47cb-a12d-6ebca32ddc40" status: 404 len: 109 microversion: 2.1 time: 0.100493 Aug 09 18:15:42.145707 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 18/38] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Aug 9 18:15:42 2022] DELETE /compute/v2.1/os-volumes/ae51ae62-dad0-47cb-a12d-6ebca32ddc40 => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:15:42.175442 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-bc60f355-7ecc-4932-91e3-888581fd1e59 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Calling method '.version_select at 0x7f4c35ffedc0>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:42.268458 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-bc60f355-7ecc-4932-91e3-888581fd1e59 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] HTTP exception thrown: Volume ae51ae62-dad0-47cb-a12d-6ebca32ddc40 could not be found. Aug 09 18:15:42.273308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-bc60f355-7ecc-4932-91e3-888581fd1e59 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Request method failure captured: Aug 09 18:15:42.273308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: GET /compute/v2.1/os-volumes/ae51ae62-dad0-47cb-a12d-6ebca32ddc40 HTTP/1.1 Aug 09 18:15:42.273308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:15:42.273308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:15:42.273308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:15:42.273308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:15:42.273308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:15:42.273308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:15:42.273308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:15:42.273308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:15:42.273308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qQ44gWNX3jj5ePM4uvlTJJHBnqwur-D1wnHxQvj8oK06IpFhMnk4xBJyCrL_IJkLuXUlTxq2K6trr74oDpfhuNcrSBalsBouPHhuXaA3vu8X2KT9iEwxgo4deIrcYVkAlGJbzMinN9TLr0HUCIA70mCa3yPsMyL4HPlXBRpGBNRXqg Aug 09 18:15:42.273308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:15:42.273308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:15:42.273308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:15:42.273308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:15:42.273308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:15:42.273308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:15:42.273308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: aa4976a9e83745b1851277848cc99c37 Aug 09 18:15:42.273308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-694770793 Aug 09 18:15:42.273308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:15:42.273308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:15:42.274610 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aa4976a9e83745b1851277848cc99c37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/aa4976a9e83745b1851277848cc99c37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_aa4976a9e83745b1851277848cc99c37", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aa4976a9e83745b1851277848cc99c37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:15:42.274610 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-VolumesSnapshotsTestJSON-694770793 Aug 09 18:15:42.274610 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: aa4976a9e83745b1851277848cc99c37 Aug 09 18:15:42.274610 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-694770793 Aug 09 18:15:42.274610 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-VolumesSnapshotsTestJSON-694770793-project Aug 09 18:15:42.274610 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:15:42.274610 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:15:42.274610 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: 7569e6a68c9d40709954daf6a5e40c08 Aug 09 18:15:42.274610 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-VolumesSnapshotsTestJSON-694770793-project Aug 09 18:15:42.274610 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: Aug 09 18:15:42.274610 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Volume ae51ae62-dad0-47cb-a12d-6ebca32ddc40 could not be found. Aug 09 18:15:42.274610 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': 'ae51ae62-dad0-47cb-a12d-6ebca32ddc40'} Aug 09 18:15:42.274610 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:15:42.275383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:42.275383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:15:42.275383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:15:42.275383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 18:15:42.275383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 18:15:42.275383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 18:15:42.275383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 18:15:42.275383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:15:42.275383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:15:42.275383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:15:42.275383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:15:42.275383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:15:42.275383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:15:42.275383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:15:42.275383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:15:42.275383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ae51ae62-dad0-47cb-a12d-6ebca32ddc40 could not be found. (HTTP 404) (Request-ID: req-f7bf42db-5cc3-41df-a4f8-dd6ee5061d68) Aug 09 18:15:42.275383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:42.275383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:42.275383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:42.276405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:42.276405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 18:15:42.276405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 18:15:42.276405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 18:15:42.276405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 18:15:42.276405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 18:15:42.276405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 18:15:42.276405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 18:15:42.276405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 18:15:42.276405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:15:42.276405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:15:42.276405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 18:15:42.276405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 18:15:42.276405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 18:15:42.276405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 18:15:42.276405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:15:42.276405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:15:42.276405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:15:42.276405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:15:42.277365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:15:42.277365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:15:42.277365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:15:42.277365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:15:42.277365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ae51ae62-dad0-47cb-a12d-6ebca32ddc40 could not be found. Aug 09 18:15:42.277365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:42.277365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:42.277365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:42.277365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:42.277365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:15:42.277365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:15:42.277365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:15:42.277365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:15:42.277365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:15:42.277365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:15:42.277365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:15:42.277365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:15:42.277365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 18:15:42.277365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:15:42.278364 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ae51ae62-dad0-47cb-a12d-6ebca32ddc40 could not be found. Aug 09 18:15:42.278364 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:42.278364 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:42.278364 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:42.278364 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:42.278364 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:15:42.278364 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:15:42.278364 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:15:42.278364 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:15:42.278364 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ae51ae62-dad0-47cb-a12d-6ebca32ddc40 could not be found. Aug 09 18:15:42.278364 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:42.284343 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-bc60f355-7ecc-4932-91e3-888581fd1e59 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] Returning 404 to user: Volume ae51ae62-dad0-47cb-a12d-6ebca32ddc40 could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:15:42.284343 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-bc60f355-7ecc-4932-91e3-888581fd1e59 tempest-VolumesSnapshotsTestJSON-694770793 tempest-VolumesSnapshotsTestJSON-694770793-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/ae51ae62-dad0-47cb-a12d-6ebca32ddc40" status: 404 len: 109 microversion: 2.1 time: 0.124038 Aug 09 18:15:42.284343 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 19/39] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Aug 9 18:15:42 2022] GET /compute/v2.1/os-volumes/ae51ae62-dad0-47cb-a12d-6ebca32ddc40 => generated 109 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:15:42.680609 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b9772bea-ef7e-4e73-979e-6d5cfc39b9a7 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:42.681762 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-b9772bea-ef7e-4e73-979e-6d5cfc39b9a7 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:42.699471 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b9772bea-ef7e-4e73-979e-6d5cfc39b9a7 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:42.704869 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b9772bea-ef7e-4e73-979e-6d5cfc39b9a7 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:42.705669 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b9772bea-ef7e-4e73-979e-6d5cfc39b9a7 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:42.711047 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b9772bea-ef7e-4e73-979e-6d5cfc39b9a7 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:42.713421 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b9772bea-ef7e-4e73-979e-6d5cfc39b9a7 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:42.714119 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b9772bea-ef7e-4e73-979e-6d5cfc39b9a7 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:43.205328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-38ed64cf-cc00-4820-a8a1-7117d4061194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Flavor limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:15:43.205852 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-38ed64cf-cc00-4820-a8a1-7117d4061194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Image limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:15:43.206511 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-38ed64cf-cc00-4820-a8a1-7117d4061194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Flavor pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:15:43.207074 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-38ed64cf-cc00-4820-a8a1-7117d4061194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Image pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:15:43.208291 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-38ed64cf-cc00-4820-a8a1-7117d4061194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:15:43.225178 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-38ed64cf-cc00-4820-a8a1-7117d4061194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:43.225954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-38ed64cf-cc00-4820-a8a1-7117d4061194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:43.227117 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-38ed64cf-cc00-4820-a8a1-7117d4061194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:43.227983 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-38ed64cf-cc00-4820-a8a1-7117d4061194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:43.229743 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-38ed64cf-cc00-4820-a8a1-7117d4061194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:43.230630 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-38ed64cf-cc00-4820-a8a1-7117d4061194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:43.341858 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-38ed64cf-cc00-4820-a8a1-7117d4061194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Getting quotas for project ac2e5c4bafff4b16bb9d82dacb5dd056. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:15:43.354132 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b9772bea-ef7e-4e73-979e-6d5cfc39b9a7 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:43.356522 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-38ed64cf-cc00-4820-a8a1-7117d4061194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Getting quotas for user 528811040ede40bdb40e3e6e666d283d and project ac2e5c4bafff4b16bb9d82dacb5dd056. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:15:43.400829 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b9772bea-ef7e-4e73-979e-6d5cfc39b9a7 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1266 microversion: 2.1 time: 0.725068 Aug 09 18:15:43.402547 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 20/40] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:42 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1266 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:15:43.408141 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d5b1294e-7db4-4436-b9b6-2112ad4fc1bf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:43.409122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d5b1294e-7db4-4436-b9b6-2112ad4fc1bf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:43.440386 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-38ed64cf-cc00-4820-a8a1-7117d4061194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Going to run 1 instances... {{(pid=118314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:15:43.455898 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-38ed64cf-cc00-4820-a8a1-7117d4061194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53732c26-c942-4646-ac3f-8d9e11ab4d57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:15:43.656292 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d5b1294e-7db4-4436-b9b6-2112ad4fc1bf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:43.674664 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d5b1294e-7db4-4436-b9b6-2112ad4fc1bf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1221 microversion: 2.1 time: 0.270692 Aug 09 18:15:43.676552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 21/41] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:43 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1221 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:15:43.686836 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-38ed64cf-cc00-4820-a8a1-7117d4061194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.008519 Aug 09 18:15:43.691638 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 21/42] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Aug 9 18:15:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 2014 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 09 18:15:43.703203 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-3677d856-7640-496f-adb3-78ed68128f1b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:43.703819 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-3677d856-7640-496f-adb3-78ed68128f1b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:43.849731 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-3677d856-7640-496f-adb3-78ed68128f1b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:43.862027 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-3677d856-7640-496f-adb3-78ed68128f1b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:43.868951 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-3677d856-7640-496f-adb3-78ed68128f1b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:43.871449 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-3677d856-7640-496f-adb3-78ed68128f1b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1282 microversion: 2.20 time: 0.172390 Aug 09 18:15:43.879258 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 22/43] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:15:43 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1282 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:15:44.427755 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-1def0105-fe46-449e-b4df-1a801ac9999a tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:44.428399 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-1def0105-fe46-449e-b4df-1a801ac9999a tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:44.453151 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1def0105-fe46-449e-b4df-1a801ac9999a tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:44.453151 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1def0105-fe46-449e-b4df-1a801ac9999a tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:44.463407 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1def0105-fe46-449e-b4df-1a801ac9999a tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:44.465692 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1def0105-fe46-449e-b4df-1a801ac9999a tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:44.471054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1def0105-fe46-449e-b4df-1a801ac9999a tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:44.472671 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1def0105-fe46-449e-b4df-1a801ac9999a tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:44.697637 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a79e6f49-547d-418f-ae65-2114bee80d7d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:44.698525 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a79e6f49-547d-418f-ae65-2114bee80d7d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:44.705909 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a79e6f49-547d-418f-ae65-2114bee80d7d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:44.706403 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a79e6f49-547d-418f-ae65-2114bee80d7d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:44.706880 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a79e6f49-547d-418f-ae65-2114bee80d7d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:44.722844 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a79e6f49-547d-418f-ae65-2114bee80d7d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:44.723927 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a79e6f49-547d-418f-ae65-2114bee80d7d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:44.727382 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a79e6f49-547d-418f-ae65-2114bee80d7d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:45.016683 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-1def0105-fe46-449e-b4df-1a801ac9999a tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:45.024906 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-1def0105-fe46-449e-b4df-1a801ac9999a tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1272 microversion: 2.1 time: 0.602189 Aug 09 18:15:45.039159 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a79e6f49-547d-418f-ae65-2114bee80d7d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:45.039656 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 22/44] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:44 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1272 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:15:45.050128 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a79e6f49-547d-418f-ae65-2114bee80d7d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1273 microversion: 2.1 time: 0.356421 Aug 09 18:15:45.052134 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 23/45] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:44 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1273 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:15:45.066306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-7b6d1e01-77d7-4878-9156-75fad5a756b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:45.067817 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-7b6d1e01-77d7-4878-9156-75fad5a756b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:45.332670 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-7b6d1e01-77d7-4878-9156-75fad5a756b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:45.344766 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-7b6d1e01-77d7-4878-9156-75fad5a756b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:45.346779 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-7b6d1e01-77d7-4878-9156-75fad5a756b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:45.354815 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-7b6d1e01-77d7-4878-9156-75fad5a756b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1282 microversion: 2.20 time: 0.313856 Aug 09 18:15:45.368219 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 23/46] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:15:45 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1282 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:15:46.060227 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-bb48d6a2-c6c8-4ab3-88a1-1302c26e0535 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:46.060843 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-bb48d6a2-c6c8-4ab3-88a1-1302c26e0535 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:46.075784 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-6eff6685-1649-4b93-af18-783c259eac43 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:46.080030 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-6eff6685-1649-4b93-af18-783c259eac43 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:46.091292 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bb48d6a2-c6c8-4ab3-88a1-1302c26e0535 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:46.093749 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6eff6685-1649-4b93-af18-783c259eac43 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:46.094261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6eff6685-1649-4b93-af18-783c259eac43 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:46.094377 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bb48d6a2-c6c8-4ab3-88a1-1302c26e0535 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:46.094757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6eff6685-1649-4b93-af18-783c259eac43 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:46.094885 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bb48d6a2-c6c8-4ab3-88a1-1302c26e0535 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:46.095583 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bb48d6a2-c6c8-4ab3-88a1-1302c26e0535 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:46.097759 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6eff6685-1649-4b93-af18-783c259eac43 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:46.101373 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6eff6685-1649-4b93-af18-783c259eac43 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:46.103938 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6eff6685-1649-4b93-af18-783c259eac43 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:46.105311 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bb48d6a2-c6c8-4ab3-88a1-1302c26e0535 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:46.110466 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bb48d6a2-c6c8-4ab3-88a1-1302c26e0535 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:46.498821 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-6eff6685-1649-4b93-af18-783c259eac43 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:46.553332 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-6eff6685-1649-4b93-af18-783c259eac43 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1279 microversion: 2.1 time: 0.474679 Aug 09 18:15:46.556866 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 24/47] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:46 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1279 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:15:46.574796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-ce071c3f-f2dc-4ee0-aa64-9e9e6837061d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:46.574981 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-bb48d6a2-c6c8-4ab3-88a1-1302c26e0535 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:46.575335 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-ce071c3f-f2dc-4ee0-aa64-9e9e6837061d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:46.593312 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-bb48d6a2-c6c8-4ab3-88a1-1302c26e0535 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.538795 Aug 09 18:15:46.607631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 24/48] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:46 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:15:46.614654 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ce071c3f-f2dc-4ee0-aa64-9e9e6837061d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:46.615198 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ce071c3f-f2dc-4ee0-aa64-9e9e6837061d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:46.615647 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ce071c3f-f2dc-4ee0-aa64-9e9e6837061d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:46.619386 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ce071c3f-f2dc-4ee0-aa64-9e9e6837061d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:46.620576 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ce071c3f-f2dc-4ee0-aa64-9e9e6837061d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:46.621060 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ce071c3f-f2dc-4ee0-aa64-9e9e6837061d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:46.774848 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-ce071c3f-f2dc-4ee0-aa64-9e9e6837061d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:46.813213 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-ce071c3f-f2dc-4ee0-aa64-9e9e6837061d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:46.826536 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-ce071c3f-f2dc-4ee0-aa64-9e9e6837061d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:46.828543 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-ce071c3f-f2dc-4ee0-aa64-9e9e6837061d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1334 microversion: 2.20 time: 0.267677 Aug 09 18:15:46.853237 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 25/49] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:15:46 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1334 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:15:47.582488 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2f269fc7-728e-47b0-bfc6-7ca00dd8ba5d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:47.583168 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-2f269fc7-728e-47b0-bfc6-7ca00dd8ba5d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:47.598960 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2f269fc7-728e-47b0-bfc6-7ca00dd8ba5d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:47.599581 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2f269fc7-728e-47b0-bfc6-7ca00dd8ba5d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:47.601115 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2f269fc7-728e-47b0-bfc6-7ca00dd8ba5d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:47.602089 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2f269fc7-728e-47b0-bfc6-7ca00dd8ba5d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:47.603183 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2f269fc7-728e-47b0-bfc6-7ca00dd8ba5d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:47.603776 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2f269fc7-728e-47b0-bfc6-7ca00dd8ba5d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:47.618789 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-46c27245-2943-46c3-92c9-4bde43a71092 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:47.620122 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-46c27245-2943-46c3-92c9-4bde43a71092 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:47.641437 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-46c27245-2943-46c3-92c9-4bde43a71092 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:47.837019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-46c27245-2943-46c3-92c9-4bde43a71092 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:47.837019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-46c27245-2943-46c3-92c9-4bde43a71092 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:47.837019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-46c27245-2943-46c3-92c9-4bde43a71092 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:47.837019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-46c27245-2943-46c3-92c9-4bde43a71092 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:47.839102 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-46c27245-2943-46c3-92c9-4bde43a71092 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:48.211578 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-2f269fc7-728e-47b0-bfc6-7ca00dd8ba5d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:48.225980 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-2f269fc7-728e-47b0-bfc6-7ca00dd8ba5d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.641884 Aug 09 18:15:48.225980 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 25/50] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:47 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:15:48.239582 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-be12ab5e-7b8e-4e7c-8acc-875d9b77347d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:48.244756 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-be12ab5e-7b8e-4e7c-8acc-875d9b77347d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:48.254934 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-be12ab5e-7b8e-4e7c-8acc-875d9b77347d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:48.254934 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-be12ab5e-7b8e-4e7c-8acc-875d9b77347d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:48.254934 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-be12ab5e-7b8e-4e7c-8acc-875d9b77347d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:48.254934 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-be12ab5e-7b8e-4e7c-8acc-875d9b77347d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:48.255410 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-be12ab5e-7b8e-4e7c-8acc-875d9b77347d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:48.255410 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-be12ab5e-7b8e-4e7c-8acc-875d9b77347d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:48.417196 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-46c27245-2943-46c3-92c9-4bde43a71092 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:48.435176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-46c27245-2943-46c3-92c9-4bde43a71092 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.817565 Aug 09 18:15:48.443215 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 26/51] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:47 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:15:48.812059 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-be12ab5e-7b8e-4e7c-8acc-875d9b77347d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:48.823333 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-be12ab5e-7b8e-4e7c-8acc-875d9b77347d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:48.824910 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-be12ab5e-7b8e-4e7c-8acc-875d9b77347d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:48.832796 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-be12ab5e-7b8e-4e7c-8acc-875d9b77347d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1342 microversion: 2.20 time: 0.606875 Aug 09 18:15:48.833416 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 26/52] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:15:48 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1342 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:15:49.247254 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-dac74259-5628-45a6-87f6-065becebeba3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:49.247880 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-dac74259-5628-45a6-87f6-065becebeba3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:49.256339 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dac74259-5628-45a6-87f6-065becebeba3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:49.256743 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dac74259-5628-45a6-87f6-065becebeba3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:49.257602 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dac74259-5628-45a6-87f6-065becebeba3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:49.258527 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dac74259-5628-45a6-87f6-065becebeba3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:49.274815 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dac74259-5628-45a6-87f6-065becebeba3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:49.278798 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dac74259-5628-45a6-87f6-065becebeba3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:49.467493 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-81bf58d7-1708-463e-908f-6b99bd06e23b tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:49.468212 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-81bf58d7-1708-463e-908f-6b99bd06e23b tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:49.482447 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-81bf58d7-1708-463e-908f-6b99bd06e23b tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:49.485210 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-81bf58d7-1708-463e-908f-6b99bd06e23b tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:49.485210 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-81bf58d7-1708-463e-908f-6b99bd06e23b tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:49.485210 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-81bf58d7-1708-463e-908f-6b99bd06e23b tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:49.485210 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-81bf58d7-1708-463e-908f-6b99bd06e23b tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:49.485494 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-81bf58d7-1708-463e-908f-6b99bd06e23b tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:50.597239 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-81bf58d7-1708-463e-908f-6b99bd06e23b tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:50.607612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-81bf58d7-1708-463e-908f-6b99bd06e23b tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 1.148072 Aug 09 18:15:50.614855 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 27/53] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:49 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:15:50.627994 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-dac74259-5628-45a6-87f6-065becebeba3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:50.654188 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-dac74259-5628-45a6-87f6-065becebeba3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 1.411905 Aug 09 18:15:50.655346 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 27/54] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:49 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:15:50.659927 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-fb03a632-d7ce-4d88-9cd7-9a7b0751f05a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:50.660581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-fb03a632-d7ce-4d88-9cd7-9a7b0751f05a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:50.690243 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fb03a632-d7ce-4d88-9cd7-9a7b0751f05a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:50.690807 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fb03a632-d7ce-4d88-9cd7-9a7b0751f05a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:50.697815 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fb03a632-d7ce-4d88-9cd7-9a7b0751f05a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:50.698863 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fb03a632-d7ce-4d88-9cd7-9a7b0751f05a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:50.703093 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fb03a632-d7ce-4d88-9cd7-9a7b0751f05a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:50.704338 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fb03a632-d7ce-4d88-9cd7-9a7b0751f05a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:51.020052 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-fb03a632-d7ce-4d88-9cd7-9a7b0751f05a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:51.037676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-fb03a632-d7ce-4d88-9cd7-9a7b0751f05a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:51.043324 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-fb03a632-d7ce-4d88-9cd7-9a7b0751f05a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:51.044687 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-fb03a632-d7ce-4d88-9cd7-9a7b0751f05a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1340 microversion: 2.20 time: 0.388384 Aug 09 18:15:51.045723 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-175dcc03-82f6-44fb-a92f-d24c5a397edc tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] Action: 'create', calling method: .version_select at 0x7f4c35fa4af0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-317884186", "metadata": {"Type": "work"}}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:15:51.052307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-175dcc03-82f6-44fb-a92f-d24c5a397edc tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] Request method failure captured: Aug 09 18:15:51.052307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 18:15:51.052307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:15:51.052307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:15:51.052307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:15:51.052307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 121 Aug 09 18:15:51.052307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:15:51.052307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:15:51.052307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:15:51.052307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:15:51.052307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qRVOYiaJxDN5JPoh3XU0uIkSP7o51wy2-3YLDX5T_UBTfk1V7qcT3fYEj_ePnVdZQipxpPfKDNgHKc2OSR5hNEc5cZOaPrkHORW5HYc3SPBneMdb5GHcAJ8aQkPpYVoWtWMjEyRQrS-4OaEt58yZGW5_O37pgOQ0oo1w61L4M_zpfs Aug 09 18:15:51.052307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:15:51.052307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:15:51.052307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:15:51.052307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:15:51.052307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:15:51.052307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:15:51.052307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: 3e6cc8830ee5419a9eca383912f27a2b Aug 09 18:15:51.052307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-VolumesNegativeTest-1314304021 Aug 09 18:15:51.052307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:15:51.052307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:15:51.053731 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e6cc8830ee5419a9eca383912f27a2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e6cc8830ee5419a9eca383912f27a2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e6cc8830ee5419a9eca383912f27a2b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e6cc8830ee5419a9eca383912f27a2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:15:51.053731 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-VolumesNegativeTest-1314304021 Aug 09 18:15:51.053731 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: 3e6cc8830ee5419a9eca383912f27a2b Aug 09 18:15:51.053731 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-VolumesNegativeTest-1314304021 Aug 09 18:15:51.053731 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-VolumesNegativeTest-1314304021-project Aug 09 18:15:51.053731 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:15:51.053731 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:15:51.053731 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: f7c50adc50bd439a9e6303b19863e7d9 Aug 09 18:15:51.053731 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-VolumesNegativeTest-1314304021-project Aug 09 18:15:51.053731 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Aug 09 18:15:51.053731 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-317884186", "metadata": {"Type": "work"}}} Aug 09 18:15:51.053731 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: Aug 09 18:15:51.053731 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 18:15:51.054604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-317884186', 'metadata': {'Type': 'work'}}}} Aug 09 18:15:51.054604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:15:51.054604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:51.054604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 18:15:51.054604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 18:15:51.054604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 18:15:51.054604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise error Aug 09 18:15:51.054604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 09 18:15:51.054604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.054604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 18:15:51.054604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 18:15:51.054604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.054604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 18:15:51.054604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi '#$%' Aug 09 18:15:51.054604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.054604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:51.054604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.054604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:51.054604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:15:51.054604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:15:51.054604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:15:51.054604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:15:51.056086 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:15:51.056086 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:15:51.056086 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:15:51.056086 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:15:51.056086 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 18:15:51.056086 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 18:15:51.056086 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 18:15:51.056086 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 18:15:51.056086 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 18:15:51.056086 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 18:15:51.056086 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 18:15:51.056086 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.056086 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:51.056086 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.056086 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:51.056086 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:15:51.056086 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:15:51.056086 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 18:15:51.056086 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 18:15:51.057401 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 18:15:51.057401 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.060996 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 28/55] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:15:50 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1340 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:15:51.065213 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-175dcc03-82f6-44fb-a92f-d24c5a397edc tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:15:51.069991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-175dcc03-82f6-44fb-a92f-d24c5a397edc tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.449936 Aug 09 18:15:51.069991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 28/56] 10.222.0.36 () {60 vars in 1156 bytes} [Tue Aug 9 18:15:50 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 451 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:15:51.077302 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-bee28339-295c-4fb3-b6f5-92f5ec1b4a15 tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] Action: 'create', calling method: .version_select at 0x7f4c35f864c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-642562835", "metadata": {"Type": "work"}}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:15:51.094096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-bee28339-295c-4fb3-b6f5-92f5ec1b4a15 tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] Request method failure captured: Aug 09 18:15:51.094096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 18:15:51.094096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:15:51.094096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:15:51.094096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:15:51.094096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 119 Aug 09 18:15:51.094096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:15:51.094096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:15:51.094096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:15:51.094096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:15:51.094096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qRVOYiaJxDN5JPoh3XU0uIkSP7o51wy2-3YLDX5T_UBTfk1V7qcT3fYEj_ePnVdZQipxpPfKDNgHKc2OSR5hNEc5cZOaPrkHORW5HYc3SPBneMdb5GHcAJ8aQkPpYVoWtWMjEyRQrS-4OaEt58yZGW5_O37pgOQ0oo1w61L4M_zpfs Aug 09 18:15:51.094096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:15:51.094096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:15:51.094096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:15:51.094096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:15:51.094096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:15:51.094096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:15:51.094096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: 3e6cc8830ee5419a9eca383912f27a2b Aug 09 18:15:51.094096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-VolumesNegativeTest-1314304021 Aug 09 18:15:51.094096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:15:51.094096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:15:51.097021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e6cc8830ee5419a9eca383912f27a2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e6cc8830ee5419a9eca383912f27a2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e6cc8830ee5419a9eca383912f27a2b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e6cc8830ee5419a9eca383912f27a2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:15:51.097021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-VolumesNegativeTest-1314304021 Aug 09 18:15:51.097021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: 3e6cc8830ee5419a9eca383912f27a2b Aug 09 18:15:51.097021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-VolumesNegativeTest-1314304021 Aug 09 18:15:51.097021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-VolumesNegativeTest-1314304021-project Aug 09 18:15:51.097021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:15:51.097021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:15:51.097021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: f7c50adc50bd439a9e6303b19863e7d9 Aug 09 18:15:51.097021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-VolumesNegativeTest-1314304021-project Aug 09 18:15:51.097021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Aug 09 18:15:51.097021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-642562835", "metadata": {"Type": "work"}}} Aug 09 18:15:51.097021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: Aug 09 18:15:51.097021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 18:15:51.098362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-642562835', 'metadata': {'Type': 'work'}}}} Aug 09 18:15:51.098362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:15:51.098362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:51.098362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 18:15:51.098362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 18:15:51.098362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 18:15:51.098362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise error Aug 09 18:15:51.098362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 09 18:15:51.098362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.098362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 09 18:15:51.098362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 18:15:51.098362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.098362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 18:15:51.098362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi '0' Aug 09 18:15:51.098362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.098362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:51.098362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.098362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:51.098362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:15:51.098362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:15:51.098362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:15:51.098362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:15:51.099936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:15:51.099936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:15:51.099936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:15:51.099936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:15:51.099936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 18:15:51.099936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 18:15:51.099936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 18:15:51.099936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 18:15:51.099936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 18:15:51.099936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 18:15:51.099936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 18:15:51.099936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.099936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:51.099936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.099936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:51.099936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:15:51.099936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:15:51.099936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 18:15:51.099936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 18:15:51.101188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 18:15:51.101188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.104512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-bee28339-295c-4fb3-b6f5-92f5ec1b4a15 tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:15:51.105397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-bee28339-295c-4fb3-b6f5-92f5ec1b4a15 tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.032431 Aug 09 18:15:51.114507 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 29/57] 10.222.0.36 () {60 vars in 1156 bytes} [Tue Aug 9 18:15:51 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:15:51.124998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b255b13c-a0dc-4a91-8b20-c21f5f91abc5 tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] Action: 'create', calling method: .version_select at 0x7f4c35f97e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1318552148", "metadata": {"Type": "work"}}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:15:51.137657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b255b13c-a0dc-4a91-8b20-c21f5f91abc5 tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] Request method failure captured: Aug 09 18:15:51.137657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 18:15:51.137657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:15:51.137657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:15:51.137657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:15:51.137657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 119 Aug 09 18:15:51.137657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:15:51.137657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:15:51.137657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:15:51.137657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:15:51.137657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qRVOYiaJxDN5JPoh3XU0uIkSP7o51wy2-3YLDX5T_UBTfk1V7qcT3fYEj_ePnVdZQipxpPfKDNgHKc2OSR5hNEc5cZOaPrkHORW5HYc3SPBneMdb5GHcAJ8aQkPpYVoWtWMjEyRQrS-4OaEt58yZGW5_O37pgOQ0oo1w61L4M_zpfs Aug 09 18:15:51.137657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:15:51.137657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:15:51.137657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:15:51.137657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:15:51.137657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:15:51.137657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:15:51.137657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: 3e6cc8830ee5419a9eca383912f27a2b Aug 09 18:15:51.137657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-VolumesNegativeTest-1314304021 Aug 09 18:15:51.137657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:15:51.137657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:15:51.138996 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e6cc8830ee5419a9eca383912f27a2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e6cc8830ee5419a9eca383912f27a2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e6cc8830ee5419a9eca383912f27a2b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e6cc8830ee5419a9eca383912f27a2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:15:51.138996 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-VolumesNegativeTest-1314304021 Aug 09 18:15:51.138996 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: 3e6cc8830ee5419a9eca383912f27a2b Aug 09 18:15:51.138996 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-VolumesNegativeTest-1314304021 Aug 09 18:15:51.138996 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-VolumesNegativeTest-1314304021-project Aug 09 18:15:51.138996 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:15:51.138996 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:15:51.138996 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: f7c50adc50bd439a9e6303b19863e7d9 Aug 09 18:15:51.138996 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-VolumesNegativeTest-1314304021-project Aug 09 18:15:51.138996 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Aug 09 18:15:51.138996 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1318552148", "metadata": {"Type": "work"}}} Aug 09 18:15:51.138996 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: Aug 09 18:15:51.138996 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 18:15:51.139700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1318552148', 'metadata': {'Type': 'work'}}}} Aug 09 18:15:51.139700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:15:51.139700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:51.139700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 18:15:51.139700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 18:15:51.139700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 18:15:51.139700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise error Aug 09 18:15:51.139700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 09 18:15:51.139700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.139700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 18:15:51.139700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 18:15:51.139700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.139700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 18:15:51.139700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi '' Aug 09 18:15:51.139700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.139700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:51.139700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.139700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:51.139700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:15:51.139700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:15:51.139700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:15:51.139700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:15:51.141041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:15:51.141041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:15:51.141041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:15:51.141041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:15:51.141041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 18:15:51.141041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 18:15:51.141041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 18:15:51.141041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 18:15:51.141041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 18:15:51.141041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 18:15:51.141041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 18:15:51.141041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.141041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:51.141041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.141041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:51.141041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:15:51.141041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:15:51.141041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 18:15:51.141041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 18:15:51.142328 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 18:15:51.142328 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.142328 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b255b13c-a0dc-4a91-8b20-c21f5f91abc5 tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:15:51.143509 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b255b13c-a0dc-4a91-8b20-c21f5f91abc5 tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.027865 Aug 09 18:15:51.147717 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 30/58] 10.222.0.36 () {60 vars in 1156 bytes} [Tue Aug 9 18:15:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:15:51.169303 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-31742205-c451-4dcd-9afe-8d635074a808 tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] Calling method '.version_select at 0x7f4c35f861f0>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:51.245917 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-3e4cbb3e-83c9-4ebc-8856-db9e437a95dc req-5ca4629d-031f-42b9-ae03-17c609895006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e0ec306-6457-418d-8cd7-b86df41c026b", "tag": "c00a6107-22ea-4149-ae88-6b763c07baf9"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:15:51.291977 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-31742205-c451-4dcd-9afe-8d635074a808 tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] HTTP exception thrown: Volume tempest-invalid-46253089 could not be found. Aug 09 18:15:51.296065 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-3e4cbb3e-83c9-4ebc-8856-db9e437a95dc req-5ca4629d-031f-42b9-ae03-17c609895006 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:51.296065 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-3e4cbb3e-83c9-4ebc-8856-db9e437a95dc req-5ca4629d-031f-42b9-ae03-17c609895006 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:51.296065 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-3e4cbb3e-83c9-4ebc-8856-db9e437a95dc req-5ca4629d-031f-42b9-ae03-17c609895006 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:51.296454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-31742205-c451-4dcd-9afe-8d635074a808 tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] Request method failure captured: Aug 09 18:15:51.296454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-46253089 HTTP/1.1 Aug 09 18:15:51.296454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:15:51.296454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:15:51.296454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:15:51.296454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:15:51.296454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:15:51.296454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:15:51.296454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:15:51.296454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:15:51.296454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qRVOYiaJxDN5JPoh3XU0uIkSP7o51wy2-3YLDX5T_UBTfk1V7qcT3fYEj_ePnVdZQipxpPfKDNgHKc2OSR5hNEc5cZOaPrkHORW5HYc3SPBneMdb5GHcAJ8aQkPpYVoWtWMjEyRQrS-4OaEt58yZGW5_O37pgOQ0oo1w61L4M_zpfs Aug 09 18:15:51.296454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:15:51.296454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:15:51.296454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:15:51.296454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:15:51.296454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:15:51.296454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:15:51.296454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: 3e6cc8830ee5419a9eca383912f27a2b Aug 09 18:15:51.296454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-VolumesNegativeTest-1314304021 Aug 09 18:15:51.296454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:15:51.296454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:15:51.297716 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e6cc8830ee5419a9eca383912f27a2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e6cc8830ee5419a9eca383912f27a2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e6cc8830ee5419a9eca383912f27a2b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e6cc8830ee5419a9eca383912f27a2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:15:51.297716 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-VolumesNegativeTest-1314304021 Aug 09 18:15:51.297716 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: 3e6cc8830ee5419a9eca383912f27a2b Aug 09 18:15:51.297716 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-VolumesNegativeTest-1314304021 Aug 09 18:15:51.297716 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-VolumesNegativeTest-1314304021-project Aug 09 18:15:51.297716 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:15:51.297716 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:15:51.297716 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: f7c50adc50bd439a9e6303b19863e7d9 Aug 09 18:15:51.297716 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-VolumesNegativeTest-1314304021-project Aug 09 18:15:51.297716 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: Aug 09 18:15:51.297716 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Volume tempest-invalid-46253089 could not be found. Aug 09 18:15:51.297716 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': 'tempest-invalid-46253089'} Aug 09 18:15:51.297716 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:15:51.298399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:51.298399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:15:51.298399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:15:51.298399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 18:15:51.298399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 18:15:51.298399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 18:15:51.298399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 18:15:51.298399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 18:15:51.298399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 18:15:51.298399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 18:15:51.298399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 18:15:51.298399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:15:51.298399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:15:51.298399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:15:51.298399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:15:51.298399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-46253089 could not be found. (HTTP 404) (Request-ID: req-80715024-8ab6-47a8-921b-1c1d56ad5ba3) Aug 09 18:15:51.298399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.298399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:51.298399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.299612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:51.299612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 18:15:51.299612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 18:15:51.299612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 18:15:51.299612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 18:15:51.299612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 18:15:51.299612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 18:15:51.299612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 18:15:51.299612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 18:15:51.299612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:15:51.299612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:15:51.299612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 18:15:51.299612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 18:15:51.299612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 18:15:51.299612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 18:15:51.299612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 18:15:51.299612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 18:15:51.299612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 18:15:51.299612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 18:15:51.301357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:15:51.301357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:15:51.301357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:15:51.301357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:15:51.301357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-46253089 could not be found. Aug 09 18:15:51.301357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.301357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:51.301357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.301357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:51.301357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:15:51.301357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:15:51.301357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:15:51.301357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:15:51.301357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:15:51.301357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:15:51.301357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:15:51.301357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:15:51.301357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 18:15:51.301357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:15:51.301357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-46253089 could not be found. Aug 09 18:15:51.302537 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.302537 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:51.302537 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.302537 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:51.302537 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:15:51.302537 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:15:51.302537 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:15:51.302537 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:15:51.302537 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-46253089 could not be found. Aug 09 18:15:51.302537 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.302537 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-31742205-c451-4dcd-9afe-8d635074a808 tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] Returning 404 to user: Volume tempest-invalid-46253089 could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:15:51.302537 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-31742205-c451-4dcd-9afe-8d635074a808 tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-46253089" status: 404 len: 97 microversion: 2.1 time: 0.141057 Aug 09 18:15:51.304299 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 31/59] 10.222.0.36 () {58 vars in 1212 bytes} [Tue Aug 9 18:15:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-46253089 => generated 97 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 18:15:51.317624 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-edb3fb10-d9ff-42a3-8b82-86172c308f36 tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004409 Aug 09 18:15:51.319188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 32/60] 10.222.0.36 () {58 vars in 1140 bytes} [Tue Aug 9 18:15:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 18:15:51.336901 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b9689d61-36c2-40d0-a7d1-f059503f96bf tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003780 Aug 09 18:15:51.338118 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 33/61] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Aug 9 18:15:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 18:15:51.347625 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-3e4cbb3e-83c9-4ebc-8856-db9e437a95dc req-5ca4629d-031f-42b9-ae03-17c609895006 service nova] Creating event network-changed:c00a6107-22ea-4149-ae88-6b763c07baf9 for instance 2e0ec306-6457-418d-8cd7-b86df41c026b on hv-cinder-79797 Aug 09 18:15:51.350368 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-3e4cbb3e-83c9-4ebc-8856-db9e437a95dc req-5ca4629d-031f-42b9-ae03-17c609895006 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118314) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 18:15:51.350802 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-3e4cbb3e-83c9-4ebc-8856-db9e437a95dc req-5ca4629d-031f-42b9-ae03-17c609895006 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118314) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 18:15:51.352803 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c325605f-1a2f-4199-a9ab-e2b9104ff73c tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] Calling method '.version_select at 0x7f4c35fa4790>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:51.358308 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2c5224d3-cd00-4b1a-a38f-2d5d0265570d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:51.360432 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2c5224d3-cd00-4b1a-a38f-2d5d0265570d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:51.364613 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2c5224d3-cd00-4b1a-a38f-2d5d0265570d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:51.365878 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2c5224d3-cd00-4b1a-a38f-2d5d0265570d None None] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:51.366995 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2c5224d3-cd00-4b1a-a38f-2d5d0265570d None None] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:51.367626 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2c5224d3-cd00-4b1a-a38f-2d5d0265570d None None] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:51.382885 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=4 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:15:51.388733 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.compute.rpcapi [None req-2c5224d3-cd00-4b1a-a38f-2d5d0265570d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 18:15:51.389873 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2c5224d3-cd00-4b1a-a38f-2d5d0265570d None None] Releasing lock "compute-rpcapi-router" {{(pid=118314) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 18:15:51.431681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-2c5224d3-cd00-4b1a-a38f-2d5d0265570d None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.367987 Aug 09 18:15:51.432525 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 29/62] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:15:51.575355 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-c325605f-1a2f-4199-a9ab-e2b9104ff73c tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] HTTP exception thrown: Volume 823d600a-eac9-4d7a-95f0-356a93a7a895 could not be found. Aug 09 18:15:51.580165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c325605f-1a2f-4199-a9ab-e2b9104ff73c tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] Request method failure captured: Aug 09 18:15:51.580165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: DELETE /compute/v2.1/os-volumes/823d600a-eac9-4d7a-95f0-356a93a7a895 HTTP/1.1 Aug 09 18:15:51.580165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:15:51.580165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:15:51.580165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:15:51.580165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:15:51.580165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:15:51.580165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:15:51.580165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:15:51.580165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:15:51.580165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qRVOYiaJxDN5JPoh3XU0uIkSP7o51wy2-3YLDX5T_UBTfk1V7qcT3fYEj_ePnVdZQipxpPfKDNgHKc2OSR5hNEc5cZOaPrkHORW5HYc3SPBneMdb5GHcAJ8aQkPpYVoWtWMjEyRQrS-4OaEt58yZGW5_O37pgOQ0oo1w61L4M_zpfs Aug 09 18:15:51.580165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:15:51.580165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:15:51.580165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:15:51.580165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:15:51.580165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:15:51.580165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:15:51.580165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: 3e6cc8830ee5419a9eca383912f27a2b Aug 09 18:15:51.580165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-VolumesNegativeTest-1314304021 Aug 09 18:15:51.580165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:15:51.580165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:15:51.581436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e6cc8830ee5419a9eca383912f27a2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e6cc8830ee5419a9eca383912f27a2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e6cc8830ee5419a9eca383912f27a2b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e6cc8830ee5419a9eca383912f27a2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:15:51.581436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-VolumesNegativeTest-1314304021 Aug 09 18:15:51.581436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: 3e6cc8830ee5419a9eca383912f27a2b Aug 09 18:15:51.581436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-VolumesNegativeTest-1314304021 Aug 09 18:15:51.581436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-VolumesNegativeTest-1314304021-project Aug 09 18:15:51.581436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:15:51.581436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:15:51.581436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: f7c50adc50bd439a9e6303b19863e7d9 Aug 09 18:15:51.581436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-VolumesNegativeTest-1314304021-project Aug 09 18:15:51.581436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: Aug 09 18:15:51.581436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Volume 823d600a-eac9-4d7a-95f0-356a93a7a895 could not be found. Aug 09 18:15:51.581436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': '823d600a-eac9-4d7a-95f0-356a93a7a895'} Aug 09 18:15:51.581436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:15:51.587585 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:51.587585 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:15:51.587585 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:15:51.587585 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 18:15:51.587585 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 18:15:51.587585 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 18:15:51.587585 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 18:15:51.587585 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 18:15:51.587585 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 18:15:51.587585 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 18:15:51.587585 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 18:15:51.587585 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:15:51.587585 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:15:51.587585 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:15:51.587585 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:15:51.587585 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 823d600a-eac9-4d7a-95f0-356a93a7a895 could not be found. (HTTP 404) (Request-ID: req-a3b8e853-b9f3-4092-b64c-94320dc5bb3e) Aug 09 18:15:51.587585 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.587585 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:51.587585 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.588821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:51.588821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 18:15:51.588821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 18:15:51.588821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 18:15:51.588821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 18:15:51.588821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 18:15:51.588821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 18:15:51.588821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 18:15:51.588821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 18:15:51.588821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:15:51.588821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:15:51.588821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 18:15:51.588821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 18:15:51.588821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 18:15:51.588821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 18:15:51.588821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 18:15:51.588821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 18:15:51.588821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 18:15:51.588821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 18:15:51.589998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:15:51.589998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:15:51.589998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:15:51.589998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:15:51.589998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 823d600a-eac9-4d7a-95f0-356a93a7a895 could not be found. Aug 09 18:15:51.589998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.589998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:51.589998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.589998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:51.589998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:15:51.589998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:15:51.589998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:15:51.589998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:15:51.589998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:15:51.589998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:15:51.589998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:15:51.589998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:15:51.589998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 18:15:51.589998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:15:51.591259 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 823d600a-eac9-4d7a-95f0-356a93a7a895 could not be found. Aug 09 18:15:51.591259 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.591259 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:51.591259 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.591259 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:51.591259 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:15:51.591259 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:15:51.591259 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:15:51.591259 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:15:51.591259 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 823d600a-eac9-4d7a-95f0-356a93a7a895 could not be found. Aug 09 18:15:51.591259 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.591259 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c325605f-1a2f-4199-a9ab-e2b9104ff73c tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] Returning 404 to user: Volume 823d600a-eac9-4d7a-95f0-356a93a7a895 could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:15:51.591259 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-c325605f-1a2f-4199-a9ab-e2b9104ff73c tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/823d600a-eac9-4d7a-95f0-356a93a7a895" status: 404 len: 109 microversion: 2.1 time: 0.236817 Aug 09 18:15:51.591259 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 34/63] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Aug 9 18:15:51 2022] DELETE /compute/v2.1/os-volumes/823d600a-eac9-4d7a-95f0-356a93a7a895 => generated 109 bytes in 238 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:15:51.595727 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-32bbd43a-e058-4aa6-9525-8ec84e38c99e tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] Calling method '.version_select at 0x7f4c357161f0>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:51.640287 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c39489f8-baa6-4d30-8aeb-7683e9c64f12 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:51.640923 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-c39489f8-baa6-4d30-8aeb-7683e9c64f12 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:51.650389 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c39489f8-baa6-4d30-8aeb-7683e9c64f12 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:51.651268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c39489f8-baa6-4d30-8aeb-7683e9c64f12 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:51.651956 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c39489f8-baa6-4d30-8aeb-7683e9c64f12 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:51.652750 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c39489f8-baa6-4d30-8aeb-7683e9c64f12 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:51.653258 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c39489f8-baa6-4d30-8aeb-7683e9c64f12 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:51.653730 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c39489f8-baa6-4d30-8aeb-7683e9c64f12 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:51.750168 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-32bbd43a-e058-4aa6-9525-8ec84e38c99e tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] HTTP exception thrown: Volume cc6f37a6-dad9-4483-830d-3a2e96cef616 could not be found. Aug 09 18:15:51.756601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-32bbd43a-e058-4aa6-9525-8ec84e38c99e tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] Request method failure captured: Aug 09 18:15:51.756601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: GET /compute/v2.1/os-volumes/cc6f37a6-dad9-4483-830d-3a2e96cef616 HTTP/1.1 Aug 09 18:15:51.756601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:15:51.756601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:15:51.756601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:15:51.756601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 0 Aug 09 18:15:51.756601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:15:51.756601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:15:51.756601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:15:51.756601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:15:51.756601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qRVOYiaJxDN5JPoh3XU0uIkSP7o51wy2-3YLDX5T_UBTfk1V7qcT3fYEj_ePnVdZQipxpPfKDNgHKc2OSR5hNEc5cZOaPrkHORW5HYc3SPBneMdb5GHcAJ8aQkPpYVoWtWMjEyRQrS-4OaEt58yZGW5_O37pgOQ0oo1w61L4M_zpfs Aug 09 18:15:51.756601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:15:51.756601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:15:51.756601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:15:51.756601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:15:51.756601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:15:51.756601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:15:51.756601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: 3e6cc8830ee5419a9eca383912f27a2b Aug 09 18:15:51.756601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-VolumesNegativeTest-1314304021 Aug 09 18:15:51.756601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:15:51.756601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:15:51.759414 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e6cc8830ee5419a9eca383912f27a2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e6cc8830ee5419a9eca383912f27a2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e6cc8830ee5419a9eca383912f27a2b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e6cc8830ee5419a9eca383912f27a2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:15:51.759414 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-VolumesNegativeTest-1314304021 Aug 09 18:15:51.759414 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: 3e6cc8830ee5419a9eca383912f27a2b Aug 09 18:15:51.759414 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-VolumesNegativeTest-1314304021 Aug 09 18:15:51.759414 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-VolumesNegativeTest-1314304021-project Aug 09 18:15:51.759414 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:15:51.759414 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:15:51.759414 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: f7c50adc50bd439a9e6303b19863e7d9 Aug 09 18:15:51.759414 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-VolumesNegativeTest-1314304021-project Aug 09 18:15:51.759414 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: Aug 09 18:15:51.759414 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Volume cc6f37a6-dad9-4483-830d-3a2e96cef616 could not be found. Aug 09 18:15:51.759414 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'id': 'cc6f37a6-dad9-4483-830d-3a2e96cef616'} Aug 09 18:15:51.759414 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:15:51.760384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:51.760384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:15:51.760384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:15:51.760384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 18:15:51.760384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 18:15:51.760384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 18:15:51.760384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 18:15:51.760384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:15:51.760384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:15:51.760384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:15:51.760384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:15:51.760384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:15:51.760384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:15:51.760384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:15:51.760384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:15:51.760384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cc6f37a6-dad9-4483-830d-3a2e96cef616 could not be found. (HTTP 404) (Request-ID: req-5c24533f-ae41-4e5a-ab7f-3bfcffd99510) Aug 09 18:15:51.760384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.760384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:51.760384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.761451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:51.761451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 18:15:51.761451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 18:15:51.761451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 18:15:51.761451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 18:15:51.761451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 18:15:51.761451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 18:15:51.761451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 18:15:51.761451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 18:15:51.761451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 18:15:51.761451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 18:15:51.761451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 18:15:51.761451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 18:15:51.761451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 18:15:51.761451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 18:15:51.761451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 18:15:51.761451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 18:15:51.761451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 18:15:51.761451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 18:15:51.762581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 18:15:51.762581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 18:15:51.762581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 18:15:51.762581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 18:15:51.762581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cc6f37a6-dad9-4483-830d-3a2e96cef616 could not be found. Aug 09 18:15:51.762581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.762581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:51.762581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.762581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:51.762581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:15:51.762581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:15:51.762581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:15:51.762581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:15:51.762581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 18:15:51.762581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 18:15:51.762581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:15:51.762581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:15:51.762581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 18:15:51.762581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:15:51.763924 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cc6f37a6-dad9-4483-830d-3a2e96cef616 could not be found. Aug 09 18:15:51.763924 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.763924 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:15:51.763924 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.763924 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:15:51.763924 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:15:51.763924 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:15:51.763924 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:15:51.763924 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:15:51.763924 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cc6f37a6-dad9-4483-830d-3a2e96cef616 could not be found. Aug 09 18:15:51.763924 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:15:51.763924 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-32bbd43a-e058-4aa6-9525-8ec84e38c99e tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] Returning 404 to user: Volume cc6f37a6-dad9-4483-830d-3a2e96cef616 could not be found. {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:15:51.765037 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-32bbd43a-e058-4aa6-9525-8ec84e38c99e tempest-VolumesNegativeTest-1314304021 tempest-VolumesNegativeTest-1314304021-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/cc6f37a6-dad9-4483-830d-3a2e96cef616" status: 404 len: 109 microversion: 2.1 time: 0.174969 Aug 09 18:15:51.775737 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 30/64] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Aug 9 18:15:51 2022] GET /compute/v2.1/os-volumes/cc6f37a6-dad9-4483-830d-3a2e96cef616 => generated 109 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:15:51.786830 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-ae7512b2-361c-4d17-9571-0c3b8cf505a9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:51.787774 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-ae7512b2-361c-4d17-9571-0c3b8cf505a9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:51.815071 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ae7512b2-361c-4d17-9571-0c3b8cf505a9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:51.816024 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ae7512b2-361c-4d17-9571-0c3b8cf505a9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:51.819883 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ae7512b2-361c-4d17-9571-0c3b8cf505a9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:51.820978 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ae7512b2-361c-4d17-9571-0c3b8cf505a9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:51.821634 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ae7512b2-361c-4d17-9571-0c3b8cf505a9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:51.829525 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ae7512b2-361c-4d17-9571-0c3b8cf505a9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:52.606545 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-c39489f8-baa6-4d30-8aeb-7683e9c64f12 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:52.616107 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-c39489f8-baa6-4d30-8aeb-7683e9c64f12 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.981096 Aug 09 18:15:52.616676 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 35/65] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:51 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:15:52.645449 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d8696be0-02d3-4cec-aa5d-010fa5f06194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:52.653553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d8696be0-02d3-4cec-aa5d-010fa5f06194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:52.662068 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d8696be0-02d3-4cec-aa5d-010fa5f06194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:52.662654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d8696be0-02d3-4cec-aa5d-010fa5f06194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:52.663111 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d8696be0-02d3-4cec-aa5d-010fa5f06194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:52.664529 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d8696be0-02d3-4cec-aa5d-010fa5f06194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:52.664996 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d8696be0-02d3-4cec-aa5d-010fa5f06194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:52.665420 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d8696be0-02d3-4cec-aa5d-010fa5f06194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:52.712580 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-ae7512b2-361c-4d17-9571-0c3b8cf505a9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:52.725089 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-ae7512b2-361c-4d17-9571-0c3b8cf505a9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.948181 Aug 09 18:15:52.754953 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 31/66] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:51 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:15:53.034507 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d8696be0-02d3-4cec-aa5d-010fa5f06194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:53.106579 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d8696be0-02d3-4cec-aa5d-010fa5f06194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:53.106579 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d8696be0-02d3-4cec-aa5d-010fa5f06194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:53.106579 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d8696be0-02d3-4cec-aa5d-010fa5f06194 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.475380 Aug 09 18:15:53.107201 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 36/67] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:15:52 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:15:53.491894 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-df864f64-75f3-4688-84ff-0f3438b8fd63 req-9be4ed00-8a4e-4d8d-8aba-cc67b230e601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67d6f4e3-a426-423e-960e-05c7bac110c9", "tag": "537d9a41-70d0-468a-aa6e-efa9b91a431a"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:15:53.515144 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-df864f64-75f3-4688-84ff-0f3438b8fd63 req-9be4ed00-8a4e-4d8d-8aba-cc67b230e601 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:53.516008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-df864f64-75f3-4688-84ff-0f3438b8fd63 req-9be4ed00-8a4e-4d8d-8aba-cc67b230e601 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:53.516634 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-df864f64-75f3-4688-84ff-0f3438b8fd63 req-9be4ed00-8a4e-4d8d-8aba-cc67b230e601 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:53.572558 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-df864f64-75f3-4688-84ff-0f3438b8fd63 req-9be4ed00-8a4e-4d8d-8aba-cc67b230e601 service nova] Creating event network-changed:537d9a41-70d0-468a-aa6e-efa9b91a431a for instance 67d6f4e3-a426-423e-960e-05c7bac110c9 on hv-cinder-79797 Aug 09 18:15:53.573143 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-df864f64-75f3-4688-84ff-0f3438b8fd63 req-9be4ed00-8a4e-4d8d-8aba-cc67b230e601 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118313) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 18:15:53.573539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-df864f64-75f3-4688-84ff-0f3438b8fd63 req-9be4ed00-8a4e-4d8d-8aba-cc67b230e601 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118313) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 18:15:53.588980 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f1852f35-5c36-44a9-b3e4-a336adf78ed2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:53.592382 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f1852f35-5c36-44a9-b3e4-a336adf78ed2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:53.592974 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f1852f35-5c36-44a9-b3e4-a336adf78ed2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:53.593984 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f1852f35-5c36-44a9-b3e4-a336adf78ed2 None None] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:53.594610 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f1852f35-5c36-44a9-b3e4-a336adf78ed2 None None] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:53.595348 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f1852f35-5c36-44a9-b3e4-a336adf78ed2 None None] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:53.620802 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.compute.rpcapi [None req-f1852f35-5c36-44a9-b3e4-a336adf78ed2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 18:15:53.622551 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f1852f35-5c36-44a9-b3e4-a336adf78ed2 None None] Releasing lock "compute-rpcapi-router" {{(pid=118313) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 18:15:53.639419 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f1852f35-5c36-44a9-b3e4-a336adf78ed2 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155053 Aug 09 18:15:53.643592 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 37/68] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:15:53.650613 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a83262ae-f1f1-49bf-9ccd-a21843a1e6f9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:53.651404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a83262ae-f1f1-49bf-9ccd-a21843a1e6f9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:53.669577 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a83262ae-f1f1-49bf-9ccd-a21843a1e6f9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:53.671243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a83262ae-f1f1-49bf-9ccd-a21843a1e6f9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:53.671848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a83262ae-f1f1-49bf-9ccd-a21843a1e6f9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:53.673193 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a83262ae-f1f1-49bf-9ccd-a21843a1e6f9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:53.673655 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a83262ae-f1f1-49bf-9ccd-a21843a1e6f9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:53.674423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a83262ae-f1f1-49bf-9ccd-a21843a1e6f9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:53.728945 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-37dfb5f2-8a88-42a3-8006-b224cb699c64 req-d3884a20-2545-4382-938c-a7ff10969d32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55a70796-1659-4326-8c40-f33454bc848c", "tag": "a941d35f-e7c7-4b47-8838-e16dd1d6f978"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:15:53.754666 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-37dfb5f2-8a88-42a3-8006-b224cb699c64 req-d3884a20-2545-4382-938c-a7ff10969d32 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:53.754666 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-37dfb5f2-8a88-42a3-8006-b224cb699c64 req-d3884a20-2545-4382-938c-a7ff10969d32 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:53.754666 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-37dfb5f2-8a88-42a3-8006-b224cb699c64 req-d3884a20-2545-4382-938c-a7ff10969d32 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:53.785172 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-37dfb5f2-8a88-42a3-8006-b224cb699c64 req-d3884a20-2545-4382-938c-a7ff10969d32 service nova] Creating event network-changed:a941d35f-e7c7-4b47-8838-e16dd1d6f978 for instance 55a70796-1659-4326-8c40-f33454bc848c on hv-cinder-79797 Aug 09 18:15:53.800289 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-37dfb5f2-8a88-42a3-8006-b224cb699c64 req-d3884a20-2545-4382-938c-a7ff10969d32 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.323764 Aug 09 18:15:53.803903 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 32/69] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:15:53.810422 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c3dba796-fbc8-4a46-a0f0-30fbd6070e57 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:53.811594 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c3dba796-fbc8-4a46-a0f0-30fbd6070e57 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:53.820963 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c3dba796-fbc8-4a46-a0f0-30fbd6070e57 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:53.821748 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c3dba796-fbc8-4a46-a0f0-30fbd6070e57 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:53.822571 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c3dba796-fbc8-4a46-a0f0-30fbd6070e57 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:53.823680 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c3dba796-fbc8-4a46-a0f0-30fbd6070e57 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:53.828200 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c3dba796-fbc8-4a46-a0f0-30fbd6070e57 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:53.828200 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c3dba796-fbc8-4a46-a0f0-30fbd6070e57 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:53.858257 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=24 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:15:54.023409 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a83262ae-f1f1-49bf-9ccd-a21843a1e6f9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:54.033344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a83262ae-f1f1-49bf-9ccd-a21843a1e6f9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.387784 Aug 09 18:15:54.033948 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 38/70] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:53 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:15:54.127646 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-dc788646-4466-4a2d-a7c9-3fe2f6d6bafe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:54.128593 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-dc788646-4466-4a2d-a7c9-3fe2f6d6bafe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:54.135258 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dc788646-4466-4a2d-a7c9-3fe2f6d6bafe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:54.135849 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dc788646-4466-4a2d-a7c9-3fe2f6d6bafe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:54.136347 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dc788646-4466-4a2d-a7c9-3fe2f6d6bafe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:54.137125 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dc788646-4466-4a2d-a7c9-3fe2f6d6bafe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:54.137669 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dc788646-4466-4a2d-a7c9-3fe2f6d6bafe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:54.138304 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dc788646-4466-4a2d-a7c9-3fe2f6d6bafe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:54.287311 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c3dba796-fbc8-4a46-a0f0-30fbd6070e57 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:54.299248 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c3dba796-fbc8-4a46-a0f0-30fbd6070e57 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.493896 Aug 09 18:15:54.299831 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 33/71] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:53 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:15:54.343063 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-dc788646-4466-4a2d-a7c9-3fe2f6d6bafe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:54.358075 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-dc788646-4466-4a2d-a7c9-3fe2f6d6bafe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:54.358075 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-dc788646-4466-4a2d-a7c9-3fe2f6d6bafe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:54.358075 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-dc788646-4466-4a2d-a7c9-3fe2f6d6bafe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.231848 Aug 09 18:15:54.358386 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 39/72] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:15:54 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:15:55.057183 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c34e6995-7d25-403f-bd87-9941f0db4442 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:55.057794 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c34e6995-7d25-403f-bd87-9941f0db4442 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:55.063846 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c34e6995-7d25-403f-bd87-9941f0db4442 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:55.064329 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c34e6995-7d25-403f-bd87-9941f0db4442 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:55.064758 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c34e6995-7d25-403f-bd87-9941f0db4442 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:55.065454 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c34e6995-7d25-403f-bd87-9941f0db4442 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:55.065907 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c34e6995-7d25-403f-bd87-9941f0db4442 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:55.066905 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c34e6995-7d25-403f-bd87-9941f0db4442 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:55.217557 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c34e6995-7d25-403f-bd87-9941f0db4442 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:55.225347 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c34e6995-7d25-403f-bd87-9941f0db4442 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.172042 Aug 09 18:15:55.225914 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 34/73] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:55 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:15:55.322935 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-0f4c3d3e-32a3-4c69-95d3-9e69a4c651fe tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:55.323613 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-0f4c3d3e-32a3-4c69-95d3-9e69a4c651fe tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:55.330016 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0f4c3d3e-32a3-4c69-95d3-9e69a4c651fe tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:55.330579 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0f4c3d3e-32a3-4c69-95d3-9e69a4c651fe tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:55.331089 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0f4c3d3e-32a3-4c69-95d3-9e69a4c651fe tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:55.332027 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0f4c3d3e-32a3-4c69-95d3-9e69a4c651fe tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:55.332695 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0f4c3d3e-32a3-4c69-95d3-9e69a4c651fe tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:55.333253 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0f4c3d3e-32a3-4c69-95d3-9e69a4c651fe tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:55.380747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-54bae683-ed89-4e07-9793-97e1986510aa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:55.381365 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-54bae683-ed89-4e07-9793-97e1986510aa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:55.383344 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=20 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:15:55.388603 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-54bae683-ed89-4e07-9793-97e1986510aa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:55.389079 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-54bae683-ed89-4e07-9793-97e1986510aa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:55.389513 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-54bae683-ed89-4e07-9793-97e1986510aa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:55.390203 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-54bae683-ed89-4e07-9793-97e1986510aa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:55.390664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-54bae683-ed89-4e07-9793-97e1986510aa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:55.391103 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-54bae683-ed89-4e07-9793-97e1986510aa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:55.524268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-0f4c3d3e-32a3-4c69-95d3-9e69a4c651fe tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:55.532847 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-0f4c3d3e-32a3-4c69-95d3-9e69a4c651fe tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.213784 Aug 09 18:15:55.543075 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 40/74] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:55 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:15:55.592277 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-54bae683-ed89-4e07-9793-97e1986510aa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:55.604191 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-54bae683-ed89-4e07-9793-97e1986510aa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:55.606092 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-54bae683-ed89-4e07-9793-97e1986510aa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:55.607285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-54bae683-ed89-4e07-9793-97e1986510aa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.231235 Aug 09 18:15:55.619318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 35/75] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:15:55 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:15:55.830318 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-8be25910-4980-42d2-ac8c-8e757e91f2d6 req-d2a5c591-6645-4c8b-a610-bc606eb771d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97", "tag": "be3a4bfe-af09-41a6-9567-0b2aabb83ff4"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:15:55.840635 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-8be25910-4980-42d2-ac8c-8e757e91f2d6 req-d2a5c591-6645-4c8b-a610-bc606eb771d3 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:55.841146 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-8be25910-4980-42d2-ac8c-8e757e91f2d6 req-d2a5c591-6645-4c8b-a610-bc606eb771d3 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:55.841577 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-8be25910-4980-42d2-ac8c-8e757e91f2d6 req-d2a5c591-6645-4c8b-a610-bc606eb771d3 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:55.853854 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-8be25910-4980-42d2-ac8c-8e757e91f2d6 req-d2a5c591-6645-4c8b-a610-bc606eb771d3 service nova] Creating event network-changed:be3a4bfe-af09-41a6-9567-0b2aabb83ff4 for instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 on hv-cinder-79797 Aug 09 18:15:55.859689 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-8be25910-4980-42d2-ac8c-8e757e91f2d6 req-d2a5c591-6645-4c8b-a610-bc606eb771d3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033121 Aug 09 18:15:55.860283 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 41/76] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:15:56.247393 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-9651643d-02f3-40b1-af0a-9b4e784541da tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:56.248012 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-9651643d-02f3-40b1-af0a-9b4e784541da tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:56.254930 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9651643d-02f3-40b1-af0a-9b4e784541da tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:56.255418 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9651643d-02f3-40b1-af0a-9b4e784541da tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:56.255853 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9651643d-02f3-40b1-af0a-9b4e784541da tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:56.256541 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9651643d-02f3-40b1-af0a-9b4e784541da tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:56.256994 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9651643d-02f3-40b1-af0a-9b4e784541da tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:56.257438 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9651643d-02f3-40b1-af0a-9b4e784541da tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:56.387191 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-9651643d-02f3-40b1-af0a-9b4e784541da tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:56.394586 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-9651643d-02f3-40b1-af0a-9b4e784541da tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.151310 Aug 09 18:15:56.395188 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 36/77] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:56 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:15:56.570693 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-dc8456e2-a951-4bc1-a095-857cb1b4366e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:56.571557 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-dc8456e2-a951-4bc1-a095-857cb1b4366e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:56.577750 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dc8456e2-a951-4bc1-a095-857cb1b4366e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:56.578232 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dc8456e2-a951-4bc1-a095-857cb1b4366e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:56.578665 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dc8456e2-a951-4bc1-a095-857cb1b4366e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:56.579386 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dc8456e2-a951-4bc1-a095-857cb1b4366e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:56.579869 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dc8456e2-a951-4bc1-a095-857cb1b4366e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:56.580293 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dc8456e2-a951-4bc1-a095-857cb1b4366e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:56.634776 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-2dd5cb14-8ddb-4808-af1c-76be9a810101 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:56.635386 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-2dd5cb14-8ddb-4808-af1c-76be9a810101 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:56.641773 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2dd5cb14-8ddb-4808-af1c-76be9a810101 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:56.642264 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2dd5cb14-8ddb-4808-af1c-76be9a810101 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:56.642697 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2dd5cb14-8ddb-4808-af1c-76be9a810101 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:56.643418 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2dd5cb14-8ddb-4808-af1c-76be9a810101 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:56.643865 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2dd5cb14-8ddb-4808-af1c-76be9a810101 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:56.644350 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2dd5cb14-8ddb-4808-af1c-76be9a810101 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:56.806123 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-dc8456e2-a951-4bc1-a095-857cb1b4366e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:56.814081 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-dc8456e2-a951-4bc1-a095-857cb1b4366e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.248349 Aug 09 18:15:56.815029 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 42/78] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:56 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:15:56.843687 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-2dd5cb14-8ddb-4808-af1c-76be9a810101 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:56.853024 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-2dd5cb14-8ddb-4808-af1c-76be9a810101 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:56.854567 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-2dd5cb14-8ddb-4808-af1c-76be9a810101 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:56.860106 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-2dd5cb14-8ddb-4808-af1c-76be9a810101 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.224845 Aug 09 18:15:56.860106 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 37/79] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:15:56 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:15:57.416100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-84545e73-e08a-4f16-b507-2d10ad710286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:57.416734 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-84545e73-e08a-4f16-b507-2d10ad710286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:57.422921 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-84545e73-e08a-4f16-b507-2d10ad710286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:57.430811 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-84545e73-e08a-4f16-b507-2d10ad710286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:57.430811 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-84545e73-e08a-4f16-b507-2d10ad710286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:57.430811 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-84545e73-e08a-4f16-b507-2d10ad710286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:57.430811 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-84545e73-e08a-4f16-b507-2d10ad710286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:57.431224 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-84545e73-e08a-4f16-b507-2d10ad710286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:57.587249 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-84545e73-e08a-4f16-b507-2d10ad710286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:57.595064 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-84545e73-e08a-4f16-b507-2d10ad710286 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.182673 Aug 09 18:15:57.595760 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 43/80] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:57 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:15:57.834891 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8e0733ea-0293-4f0d-911d-c96597f5b868 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:57.835783 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8e0733ea-0293-4f0d-911d-c96597f5b868 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:57.841638 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e0733ea-0293-4f0d-911d-c96597f5b868 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:57.842126 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e0733ea-0293-4f0d-911d-c96597f5b868 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:57.842677 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e0733ea-0293-4f0d-911d-c96597f5b868 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:57.843388 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e0733ea-0293-4f0d-911d-c96597f5b868 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:57.843850 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e0733ea-0293-4f0d-911d-c96597f5b868 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:57.844275 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e0733ea-0293-4f0d-911d-c96597f5b868 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:57.879410 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6fe8d0c1-6038-4ffe-b2c5-ad78cba5631a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:57.880907 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-6fe8d0c1-6038-4ffe-b2c5-ad78cba5631a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:57.888510 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6fe8d0c1-6038-4ffe-b2c5-ad78cba5631a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:57.889986 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6fe8d0c1-6038-4ffe-b2c5-ad78cba5631a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:57.890492 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6fe8d0c1-6038-4ffe-b2c5-ad78cba5631a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:57.891608 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6fe8d0c1-6038-4ffe-b2c5-ad78cba5631a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:57.892061 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6fe8d0c1-6038-4ffe-b2c5-ad78cba5631a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:57.892641 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6fe8d0c1-6038-4ffe-b2c5-ad78cba5631a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:58.061002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8e0733ea-0293-4f0d-911d-c96597f5b868 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:58.069917 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8e0733ea-0293-4f0d-911d-c96597f5b868 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.238905 Aug 09 18:15:58.070617 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 38/81] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:57 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:15:58.080653 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6fe8d0c1-6038-4ffe-b2c5-ad78cba5631a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:58.090830 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6fe8d0c1-6038-4ffe-b2c5-ad78cba5631a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:58.092365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6fe8d0c1-6038-4ffe-b2c5-ad78cba5631a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:58.094044 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-6fe8d0c1-6038-4ffe-b2c5-ad78cba5631a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.218327 Aug 09 18:15:58.094765 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 44/82] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:15:57 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:15:58.621971 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-ce18c7e4-819b-4cde-a398-55c72362d155 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:58.623373 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-ce18c7e4-819b-4cde-a398-55c72362d155 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:58.634830 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ce18c7e4-819b-4cde-a398-55c72362d155 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:58.637313 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ce18c7e4-819b-4cde-a398-55c72362d155 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:58.639052 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ce18c7e4-819b-4cde-a398-55c72362d155 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:58.639938 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ce18c7e4-819b-4cde-a398-55c72362d155 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:58.642746 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ce18c7e4-819b-4cde-a398-55c72362d155 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:58.643356 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ce18c7e4-819b-4cde-a398-55c72362d155 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:58.845470 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-ce18c7e4-819b-4cde-a398-55c72362d155 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:58.849462 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=100 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:15:58.854276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-ce18c7e4-819b-4cde-a398-55c72362d155 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.238812 Aug 09 18:15:58.854885 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 39/83] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:58 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:15:59.092974 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-52261d14-cc11-424f-a589-81b0a1808aca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:59.093953 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-52261d14-cc11-424f-a589-81b0a1808aca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:59.103116 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-52261d14-cc11-424f-a589-81b0a1808aca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:59.104515 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-52261d14-cc11-424f-a589-81b0a1808aca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:59.105494 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-52261d14-cc11-424f-a589-81b0a1808aca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:59.106420 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-52261d14-cc11-424f-a589-81b0a1808aca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:59.107222 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-52261d14-cc11-424f-a589-81b0a1808aca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:59.107721 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-52261d14-cc11-424f-a589-81b0a1808aca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:59.119051 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-bd0594cf-796a-43c9-bfee-82d2e374ca5c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:59.119721 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-bd0594cf-796a-43c9-bfee-82d2e374ca5c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:59.126530 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bd0594cf-796a-43c9-bfee-82d2e374ca5c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:59.127925 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bd0594cf-796a-43c9-bfee-82d2e374ca5c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:59.129092 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bd0594cf-796a-43c9-bfee-82d2e374ca5c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:59.130050 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bd0594cf-796a-43c9-bfee-82d2e374ca5c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:59.130742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bd0594cf-796a-43c9-bfee-82d2e374ca5c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:59.131382 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bd0594cf-796a-43c9-bfee-82d2e374ca5c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:59.353541 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-bd0594cf-796a-43c9-bfee-82d2e374ca5c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:59.361525 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-bd0594cf-796a-43c9-bfee-82d2e374ca5c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:59.364157 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-bd0594cf-796a-43c9-bfee-82d2e374ca5c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:59.365281 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-bd0594cf-796a-43c9-bfee-82d2e374ca5c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.251027 Aug 09 18:15:59.365832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 40/84] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:15:59 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:15:59.366775 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-52261d14-cc11-424f-a589-81b0a1808aca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:59.370441 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=100 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:15:59.375305 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-52261d14-cc11-424f-a589-81b0a1808aca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.286282 Aug 09 18:15:59.378741 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 45/85] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:59 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:15:59.881082 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d46e7a9e-853d-48d3-bad5-893f03c7c743 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:59.881721 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d46e7a9e-853d-48d3-bad5-893f03c7c743 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:59.888498 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d46e7a9e-853d-48d3-bad5-893f03c7c743 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:59.888982 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d46e7a9e-853d-48d3-bad5-893f03c7c743 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:59.889528 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d46e7a9e-853d-48d3-bad5-893f03c7c743 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:59.890212 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d46e7a9e-853d-48d3-bad5-893f03c7c743 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:59.890661 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d46e7a9e-853d-48d3-bad5-893f03c7c743 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:59.891132 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d46e7a9e-853d-48d3-bad5-893f03c7c743 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:00.043767 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d46e7a9e-853d-48d3-bad5-893f03c7c743 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:00.052109 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d46e7a9e-853d-48d3-bad5-893f03c7c743 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.175216 Aug 09 18:16:00.052684 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 41/86] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:59 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:00.387153 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b561f751-55cc-4c66-ae2a-3102966c79d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:00.387757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-b561f751-55cc-4c66-ae2a-3102966c79d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:00.395009 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b561f751-55cc-4c66-ae2a-3102966c79d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:00.395550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b561f751-55cc-4c66-ae2a-3102966c79d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:00.396232 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b561f751-55cc-4c66-ae2a-3102966c79d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:00.396798 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e3ec50c7-7f13-452c-b674-fd8cbd66d6f7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:00.396937 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b561f751-55cc-4c66-ae2a-3102966c79d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:00.397591 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b561f751-55cc-4c66-ae2a-3102966c79d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:00.397712 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e3ec50c7-7f13-452c-b674-fd8cbd66d6f7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:00.398022 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b561f751-55cc-4c66-ae2a-3102966c79d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:00.406948 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3ec50c7-7f13-452c-b674-fd8cbd66d6f7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:00.414507 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3ec50c7-7f13-452c-b674-fd8cbd66d6f7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:00.414507 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3ec50c7-7f13-452c-b674-fd8cbd66d6f7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:00.414507 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3ec50c7-7f13-452c-b674-fd8cbd66d6f7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:00.414507 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3ec50c7-7f13-452c-b674-fd8cbd66d6f7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:00.415066 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3ec50c7-7f13-452c-b674-fd8cbd66d6f7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:00.672103 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b561f751-55cc-4c66-ae2a-3102966c79d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:00.680639 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b561f751-55cc-4c66-ae2a-3102966c79d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:00.682318 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b561f751-55cc-4c66-ae2a-3102966c79d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:00.683451 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b561f751-55cc-4c66-ae2a-3102966c79d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.300151 Aug 09 18:16:00.683976 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e3ec50c7-7f13-452c-b674-fd8cbd66d6f7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:00.684107 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 46/87] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:00 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:16:00.692201 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e3ec50c7-7f13-452c-b674-fd8cbd66d6f7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.299111 Aug 09 18:16:00.692818 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 42/88] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:00 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:01.074476 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9c846c6a-c26e-43d2-89e8-176f9790cdf5 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:01.075114 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9c846c6a-c26e-43d2-89e8-176f9790cdf5 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:01.080843 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9c846c6a-c26e-43d2-89e8-176f9790cdf5 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:01.081318 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9c846c6a-c26e-43d2-89e8-176f9790cdf5 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:01.082375 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9c846c6a-c26e-43d2-89e8-176f9790cdf5 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:01.083079 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9c846c6a-c26e-43d2-89e8-176f9790cdf5 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:01.083533 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9c846c6a-c26e-43d2-89e8-176f9790cdf5 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:01.084530 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9c846c6a-c26e-43d2-89e8-176f9790cdf5 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:01.224920 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9c846c6a-c26e-43d2-89e8-176f9790cdf5 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:01.233051 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9c846c6a-c26e-43d2-89e8-176f9790cdf5 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.162021 Aug 09 18:16:01.233986 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 47/89] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:01 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:01.708447 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e2141965-0c57-42ed-9a02-98d503f99af4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:01.709395 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e2141965-0c57-42ed-9a02-98d503f99af4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:01.716291 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=6 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:16:01.718073 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e2141965-0c57-42ed-9a02-98d503f99af4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:01.718454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-3455ebbb-542e-416c-8cf7-b5e0c0266635 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:01.719020 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e2141965-0c57-42ed-9a02-98d503f99af4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:01.719657 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e2141965-0c57-42ed-9a02-98d503f99af4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:01.719946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-3455ebbb-542e-416c-8cf7-b5e0c0266635 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:01.720497 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e2141965-0c57-42ed-9a02-98d503f99af4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:01.720989 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e2141965-0c57-42ed-9a02-98d503f99af4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:01.721818 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e2141965-0c57-42ed-9a02-98d503f99af4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:01.727077 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3455ebbb-542e-416c-8cf7-b5e0c0266635 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:01.727569 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3455ebbb-542e-416c-8cf7-b5e0c0266635 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:01.728005 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3455ebbb-542e-416c-8cf7-b5e0c0266635 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:01.728888 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3455ebbb-542e-416c-8cf7-b5e0c0266635 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:01.729332 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3455ebbb-542e-416c-8cf7-b5e0c0266635 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:01.729975 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3455ebbb-542e-416c-8cf7-b5e0c0266635 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:01.949387 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-3455ebbb-542e-416c-8cf7-b5e0c0266635 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:01.962638 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-3455ebbb-542e-416c-8cf7-b5e0c0266635 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.250216 Aug 09 18:16:01.963810 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 48/90] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:01 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:01.974447 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e2141965-0c57-42ed-9a02-98d503f99af4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:01.985504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e2141965-0c57-42ed-9a02-98d503f99af4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:01.987505 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e2141965-0c57-42ed-9a02-98d503f99af4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:01.989980 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e2141965-0c57-42ed-9a02-98d503f99af4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.285501 Aug 09 18:16:01.990639 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 43/91] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:01 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:16:02.292869 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e2afbde2-2acd-42e8-8291-172b7da10112 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:02.292869 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e2afbde2-2acd-42e8-8291-172b7da10112 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:02.292869 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e2afbde2-2acd-42e8-8291-172b7da10112 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:02.292869 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e2afbde2-2acd-42e8-8291-172b7da10112 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:02.293168 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e2afbde2-2acd-42e8-8291-172b7da10112 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:02.293168 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e2afbde2-2acd-42e8-8291-172b7da10112 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:02.293168 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e2afbde2-2acd-42e8-8291-172b7da10112 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:02.293168 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e2afbde2-2acd-42e8-8291-172b7da10112 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:02.404793 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e2afbde2-2acd-42e8-8291-172b7da10112 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:02.410868 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e2afbde2-2acd-42e8-8291-172b7da10112 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.159471 Aug 09 18:16:02.411427 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 49/92] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:02 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:02.983765 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-15d24168-9657-4cca-a426-469213c23579 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:02.984425 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-15d24168-9657-4cca-a426-469213c23579 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:02.986244 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:16:02.991265 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15d24168-9657-4cca-a426-469213c23579 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:02.991747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15d24168-9657-4cca-a426-469213c23579 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:02.992178 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15d24168-9657-4cca-a426-469213c23579 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:02.992859 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15d24168-9657-4cca-a426-469213c23579 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:02.993311 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15d24168-9657-4cca-a426-469213c23579 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:02.993731 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15d24168-9657-4cca-a426-469213c23579 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:03.013327 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c6cf8c9d-2590-4316-af9d-c831b39c29e5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:03.016791 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-c6cf8c9d-2590-4316-af9d-c831b39c29e5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:03.016963 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:16:03.021379 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c6cf8c9d-2590-4316-af9d-c831b39c29e5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:03.021864 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c6cf8c9d-2590-4316-af9d-c831b39c29e5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:03.022300 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c6cf8c9d-2590-4316-af9d-c831b39c29e5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:03.023008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c6cf8c9d-2590-4316-af9d-c831b39c29e5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:03.023459 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c6cf8c9d-2590-4316-af9d-c831b39c29e5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:03.023903 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c6cf8c9d-2590-4316-af9d-c831b39c29e5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:03.195611 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-15d24168-9657-4cca-a426-469213c23579 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:03.199818 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-c6cf8c9d-2590-4316-af9d-c831b39c29e5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:03.205610 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-15d24168-9657-4cca-a426-469213c23579 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.225431 Aug 09 18:16:03.206863 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 44/93] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:02 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:03.208350 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-c6cf8c9d-2590-4316-af9d-c831b39c29e5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:03.209866 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-c6cf8c9d-2590-4316-af9d-c831b39c29e5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:03.211030 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-c6cf8c9d-2590-4316-af9d-c831b39c29e5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.201629 Aug 09 18:16:03.211625 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 50/94] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:03 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:03.431534 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-a55a45d2-d1a9-4587-920a-6108305eaa07 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:03.432059 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-a55a45d2-d1a9-4587-920a-6108305eaa07 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:03.437966 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a55a45d2-d1a9-4587-920a-6108305eaa07 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:03.438444 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a55a45d2-d1a9-4587-920a-6108305eaa07 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:03.438905 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a55a45d2-d1a9-4587-920a-6108305eaa07 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:03.439583 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a55a45d2-d1a9-4587-920a-6108305eaa07 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:03.440028 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a55a45d2-d1a9-4587-920a-6108305eaa07 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:03.440447 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a55a45d2-d1a9-4587-920a-6108305eaa07 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:03.573458 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a55a45d2-d1a9-4587-920a-6108305eaa07 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:03.581082 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-a55a45d2-d1a9-4587-920a-6108305eaa07 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.153349 Aug 09 18:16:03.582017 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 45/95] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:03 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:04.227093 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c049ed84-01b9-46a9-8000-27155cf3d19d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:04.227704 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-c049ed84-01b9-46a9-8000-27155cf3d19d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:04.229531 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=2 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:16:04.233025 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-754cbfcb-b24a-47b9-826a-3dc269deea29 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:04.233640 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-754cbfcb-b24a-47b9-826a-3dc269deea29 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:04.234462 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c049ed84-01b9-46a9-8000-27155cf3d19d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:04.234979 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c049ed84-01b9-46a9-8000-27155cf3d19d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:04.235630 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c049ed84-01b9-46a9-8000-27155cf3d19d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:04.236326 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c049ed84-01b9-46a9-8000-27155cf3d19d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:04.237035 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c049ed84-01b9-46a9-8000-27155cf3d19d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:04.237529 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c049ed84-01b9-46a9-8000-27155cf3d19d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:04.240508 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-754cbfcb-b24a-47b9-826a-3dc269deea29 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:04.240995 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-754cbfcb-b24a-47b9-826a-3dc269deea29 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:04.241430 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-754cbfcb-b24a-47b9-826a-3dc269deea29 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:04.242120 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-754cbfcb-b24a-47b9-826a-3dc269deea29 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:04.242579 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-754cbfcb-b24a-47b9-826a-3dc269deea29 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:04.243030 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-754cbfcb-b24a-47b9-826a-3dc269deea29 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:04.432753 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-c049ed84-01b9-46a9-8000-27155cf3d19d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:04.436797 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-754cbfcb-b24a-47b9-826a-3dc269deea29 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:04.440169 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-c049ed84-01b9-46a9-8000-27155cf3d19d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.216814 Aug 09 18:16:04.440805 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 51/96] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:04 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:04.445078 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-754cbfcb-b24a-47b9-826a-3dc269deea29 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:04.446570 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-754cbfcb-b24a-47b9-826a-3dc269deea29 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:04.447684 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-754cbfcb-b24a-47b9-826a-3dc269deea29 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.218635 Aug 09 18:16:04.448221 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 46/97] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:04 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:04.602596 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9f0a318f-1239-42f7-849b-6058366c0070 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:04.603880 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9f0a318f-1239-42f7-849b-6058366c0070 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:04.609250 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9f0a318f-1239-42f7-849b-6058366c0070 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:04.609734 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9f0a318f-1239-42f7-849b-6058366c0070 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:04.610175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9f0a318f-1239-42f7-849b-6058366c0070 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:04.610909 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9f0a318f-1239-42f7-849b-6058366c0070 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:04.611369 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9f0a318f-1239-42f7-849b-6058366c0070 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:04.612047 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9f0a318f-1239-42f7-849b-6058366c0070 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:04.740588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9f0a318f-1239-42f7-849b-6058366c0070 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:04.747935 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9f0a318f-1239-42f7-849b-6058366c0070 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.149358 Aug 09 18:16:04.748691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 52/98] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:04 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:05.461856 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-ffc27022-d713-4adf-894b-ae34053916c2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:05.462519 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-ffc27022-d713-4adf-894b-ae34053916c2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:05.469056 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ffc27022-d713-4adf-894b-ae34053916c2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:05.469541 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ffc27022-d713-4adf-894b-ae34053916c2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:05.469974 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ffc27022-d713-4adf-894b-ae34053916c2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:05.470187 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a089fa80-2a2e-4eb9-ac4c-40dad7d83944 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:05.470654 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ffc27022-d713-4adf-894b-ae34053916c2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:05.470954 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a089fa80-2a2e-4eb9-ac4c-40dad7d83944 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:05.471245 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ffc27022-d713-4adf-894b-ae34053916c2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:05.471667 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ffc27022-d713-4adf-894b-ae34053916c2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:05.477916 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a089fa80-2a2e-4eb9-ac4c-40dad7d83944 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:05.478489 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a089fa80-2a2e-4eb9-ac4c-40dad7d83944 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:05.478956 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a089fa80-2a2e-4eb9-ac4c-40dad7d83944 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:05.479644 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a089fa80-2a2e-4eb9-ac4c-40dad7d83944 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:05.480100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a089fa80-2a2e-4eb9-ac4c-40dad7d83944 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:05.480526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a089fa80-2a2e-4eb9-ac4c-40dad7d83944 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:05.785694 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a089fa80-2a2e-4eb9-ac4c-40dad7d83944 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:05.791205 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-ffc27022-d713-4adf-894b-ae34053916c2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:05.793678 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a089fa80-2a2e-4eb9-ac4c-40dad7d83944 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:05.795330 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a089fa80-2a2e-4eb9-ac4c-40dad7d83944 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:05.796463 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a089fa80-2a2e-4eb9-ac4c-40dad7d83944 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.330664 Aug 09 18:16:05.802668 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-ffc27022-d713-4adf-894b-ae34053916c2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.342167 Aug 09 18:16:05.807221 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 53/99] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:05 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:05.821322 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 47/100] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:05 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:05.830619 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-bac6104c-2662-4c7b-9fee-ed7e7f4828bb tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:05.832609 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-bac6104c-2662-4c7b-9fee-ed7e7f4828bb tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:05.840645 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bac6104c-2662-4c7b-9fee-ed7e7f4828bb tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:05.841367 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bac6104c-2662-4c7b-9fee-ed7e7f4828bb tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:05.842915 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bac6104c-2662-4c7b-9fee-ed7e7f4828bb tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:05.844513 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bac6104c-2662-4c7b-9fee-ed7e7f4828bb tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:05.845175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bac6104c-2662-4c7b-9fee-ed7e7f4828bb tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:05.845821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bac6104c-2662-4c7b-9fee-ed7e7f4828bb tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:06.130877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-bac6104c-2662-4c7b-9fee-ed7e7f4828bb tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:06.138393 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-bac6104c-2662-4c7b-9fee-ed7e7f4828bb tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.329906 Aug 09 18:16:06.139155 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 54/101] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:05 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:06.822189 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-5cb13a2d-230d-4deb-830b-5ad1d3389f08 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:06.824551 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-5cb13a2d-230d-4deb-830b-5ad1d3389f08 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:06.830742 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-da8df516-0e84-4dc1-8c95-0b8a4c77222b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:06.832035 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-da8df516-0e84-4dc1-8c95-0b8a4c77222b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:06.833931 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5cb13a2d-230d-4deb-830b-5ad1d3389f08 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:06.834595 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5cb13a2d-230d-4deb-830b-5ad1d3389f08 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:06.835060 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5cb13a2d-230d-4deb-830b-5ad1d3389f08 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:06.836328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5cb13a2d-230d-4deb-830b-5ad1d3389f08 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:06.836925 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5cb13a2d-230d-4deb-830b-5ad1d3389f08 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:06.837581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5cb13a2d-230d-4deb-830b-5ad1d3389f08 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:06.839405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-da8df516-0e84-4dc1-8c95-0b8a4c77222b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:06.839961 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-da8df516-0e84-4dc1-8c95-0b8a4c77222b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:06.840686 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-da8df516-0e84-4dc1-8c95-0b8a4c77222b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:06.841587 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-da8df516-0e84-4dc1-8c95-0b8a4c77222b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:06.842283 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-da8df516-0e84-4dc1-8c95-0b8a4c77222b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:06.842948 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-da8df516-0e84-4dc1-8c95-0b8a4c77222b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:07.059201 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-da8df516-0e84-4dc1-8c95-0b8a4c77222b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:07.066300 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-5cb13a2d-230d-4deb-830b-5ad1d3389f08 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:07.072866 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-da8df516-0e84-4dc1-8c95-0b8a4c77222b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.246660 Aug 09 18:16:07.073652 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 55/102] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:06 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:07.076297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-5cb13a2d-230d-4deb-830b-5ad1d3389f08 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:07.078091 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-5cb13a2d-230d-4deb-830b-5ad1d3389f08 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:07.079472 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-5cb13a2d-230d-4deb-830b-5ad1d3389f08 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.262111 Aug 09 18:16:07.080250 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 48/103] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:06 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:16:07.160960 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-30087a8a-b3c6-46a2-bfe9-9127ec8f98aa tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:07.161566 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-30087a8a-b3c6-46a2-bfe9-9127ec8f98aa tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:07.167607 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-30087a8a-b3c6-46a2-bfe9-9127ec8f98aa tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:07.168083 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-30087a8a-b3c6-46a2-bfe9-9127ec8f98aa tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:07.168514 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-30087a8a-b3c6-46a2-bfe9-9127ec8f98aa tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:07.169193 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-30087a8a-b3c6-46a2-bfe9-9127ec8f98aa tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:07.169641 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-30087a8a-b3c6-46a2-bfe9-9127ec8f98aa tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:07.170059 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-30087a8a-b3c6-46a2-bfe9-9127ec8f98aa tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:07.310858 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-30087a8a-b3c6-46a2-bfe9-9127ec8f98aa tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:07.317417 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-30087a8a-b3c6-46a2-bfe9-9127ec8f98aa tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.160775 Aug 09 18:16:07.318116 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 56/104] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:07 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:08.097213 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-3f04f57c-3130-4c14-9352-a621a24078a5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:08.097845 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-3f04f57c-3130-4c14-9352-a621a24078a5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:08.102634 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-457e7015-1887-494e-98bd-dddf169b31d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:08.103290 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-457e7015-1887-494e-98bd-dddf169b31d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:08.104522 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3f04f57c-3130-4c14-9352-a621a24078a5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:08.105042 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3f04f57c-3130-4c14-9352-a621a24078a5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:08.105481 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3f04f57c-3130-4c14-9352-a621a24078a5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:08.106281 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3f04f57c-3130-4c14-9352-a621a24078a5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:08.106826 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3f04f57c-3130-4c14-9352-a621a24078a5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:08.107302 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3f04f57c-3130-4c14-9352-a621a24078a5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:08.109232 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-457e7015-1887-494e-98bd-dddf169b31d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:08.109701 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-457e7015-1887-494e-98bd-dddf169b31d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:08.110138 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-457e7015-1887-494e-98bd-dddf169b31d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:08.110860 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-457e7015-1887-494e-98bd-dddf169b31d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:08.111317 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-457e7015-1887-494e-98bd-dddf169b31d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:08.112000 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-457e7015-1887-494e-98bd-dddf169b31d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:08.442411 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-457e7015-1887-494e-98bd-dddf169b31d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:08.450423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-457e7015-1887-494e-98bd-dddf169b31d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:08.452087 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-457e7015-1887-494e-98bd-dddf169b31d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:08.453180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-457e7015-1887-494e-98bd-dddf169b31d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.354427 Aug 09 18:16:08.453306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-3f04f57c-3130-4c14-9352-a621a24078a5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:08.453742 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 57/105] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:08 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:08.469983 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-3f04f57c-3130-4c14-9352-a621a24078a5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.368471 Aug 09 18:16:08.470130 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-0486ba6f-1689-442c-a724-693d30b9f4cf tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:08.470242 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 49/106] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:08 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:08.470325 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-0486ba6f-1689-442c-a724-693d30b9f4cf tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:08.470325 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0486ba6f-1689-442c-a724-693d30b9f4cf tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:08.470325 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0486ba6f-1689-442c-a724-693d30b9f4cf tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:08.470325 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0486ba6f-1689-442c-a724-693d30b9f4cf tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:08.470597 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0486ba6f-1689-442c-a724-693d30b9f4cf tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:08.470597 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0486ba6f-1689-442c-a724-693d30b9f4cf tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:08.470914 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0486ba6f-1689-442c-a724-693d30b9f4cf tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:08.636343 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-0486ba6f-1689-442c-a724-693d30b9f4cf tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:08.643720 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-0486ba6f-1689-442c-a724-693d30b9f4cf tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.187967 Aug 09 18:16:08.644810 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 58/107] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:08 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:09.477424 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e7513989-8e01-43db-9a68-5f2e886bbb9a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:09.479325 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e7513989-8e01-43db-9a68-5f2e886bbb9a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:09.483586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-67f1a639-ae91-4f66-87a1-4752c83a4a11 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:09.484522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-67f1a639-ae91-4f66-87a1-4752c83a4a11 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:09.485915 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7513989-8e01-43db-9a68-5f2e886bbb9a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:09.487816 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7513989-8e01-43db-9a68-5f2e886bbb9a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:09.488851 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7513989-8e01-43db-9a68-5f2e886bbb9a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:09.489693 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7513989-8e01-43db-9a68-5f2e886bbb9a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:09.490152 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7513989-8e01-43db-9a68-5f2e886bbb9a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:09.490775 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7513989-8e01-43db-9a68-5f2e886bbb9a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:09.491717 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-67f1a639-ae91-4f66-87a1-4752c83a4a11 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:09.492205 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-67f1a639-ae91-4f66-87a1-4752c83a4a11 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:09.492640 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-67f1a639-ae91-4f66-87a1-4752c83a4a11 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:09.494336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-67f1a639-ae91-4f66-87a1-4752c83a4a11 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:09.494336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-67f1a639-ae91-4f66-87a1-4752c83a4a11 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:09.494336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-67f1a639-ae91-4f66-87a1-4752c83a4a11 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:09.694640 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-67f1a639-ae91-4f66-87a1-4752c83a4a11 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:09.703615 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-67f1a639-ae91-4f66-87a1-4752c83a4a11 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.224258 Aug 09 18:16:09.704190 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 59/108] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:09 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:09.710511 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e7513989-8e01-43db-9a68-5f2e886bbb9a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:09.717078 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-ff0d20b7-88a1-4725-9bd3-76f6ae0301f0 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:09.717721 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-ff0d20b7-88a1-4725-9bd3-76f6ae0301f0 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:09.720589 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e7513989-8e01-43db-9a68-5f2e886bbb9a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:09.723410 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e7513989-8e01-43db-9a68-5f2e886bbb9a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:09.724295 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ff0d20b7-88a1-4725-9bd3-76f6ae0301f0 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:09.724781 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ff0d20b7-88a1-4725-9bd3-76f6ae0301f0 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:09.724909 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e7513989-8e01-43db-9a68-5f2e886bbb9a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.252927 Aug 09 18:16:09.725215 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ff0d20b7-88a1-4725-9bd3-76f6ae0301f0 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:09.730756 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 50/109] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:09 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:16:09.730914 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ff0d20b7-88a1-4725-9bd3-76f6ae0301f0 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:09.730914 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ff0d20b7-88a1-4725-9bd3-76f6ae0301f0 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:09.730914 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ff0d20b7-88a1-4725-9bd3-76f6ae0301f0 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:09.861740 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ff0d20b7-88a1-4725-9bd3-76f6ae0301f0 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:09.869838 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-ff0d20b7-88a1-4725-9bd3-76f6ae0301f0 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.164498 Aug 09 18:16:09.870528 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 60/110] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:09 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:10.727608 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e3a09c1d-7279-4ebf-a7b1-0ed9c84a877c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:10.728796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e3a09c1d-7279-4ebf-a7b1-0ed9c84a877c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:10.734649 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3a09c1d-7279-4ebf-a7b1-0ed9c84a877c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:10.740832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3a09c1d-7279-4ebf-a7b1-0ed9c84a877c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:10.740832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3a09c1d-7279-4ebf-a7b1-0ed9c84a877c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:10.740832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3a09c1d-7279-4ebf-a7b1-0ed9c84a877c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:10.740832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3a09c1d-7279-4ebf-a7b1-0ed9c84a877c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:10.741186 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3a09c1d-7279-4ebf-a7b1-0ed9c84a877c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:10.748382 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a8aec281-253c-4725-a449-a48c47b26fa0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:10.748984 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a8aec281-253c-4725-a449-a48c47b26fa0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:10.755020 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a8aec281-253c-4725-a449-a48c47b26fa0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:10.755504 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a8aec281-253c-4725-a449-a48c47b26fa0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:10.755941 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a8aec281-253c-4725-a449-a48c47b26fa0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:10.756624 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a8aec281-253c-4725-a449-a48c47b26fa0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:10.757069 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a8aec281-253c-4725-a449-a48c47b26fa0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:10.757488 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a8aec281-253c-4725-a449-a48c47b26fa0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:10.952634 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e3a09c1d-7279-4ebf-a7b1-0ed9c84a877c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:10.956662 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a8aec281-253c-4725-a449-a48c47b26fa0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:10.960880 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e3a09c1d-7279-4ebf-a7b1-0ed9c84a877c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.237295 Aug 09 18:16:10.961453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 51/111] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:10 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:10.965944 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-60888d98-d174-4527-bf6a-5ce60b4e080c tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:10.966587 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-60888d98-d174-4527-bf6a-5ce60b4e080c tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:10.975235 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-60888d98-d174-4527-bf6a-5ce60b4e080c tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:10.975794 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-60888d98-d174-4527-bf6a-5ce60b4e080c tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:10.976131 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-60888d98-d174-4527-bf6a-5ce60b4e080c tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:10.976360 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a8aec281-253c-4725-a449-a48c47b26fa0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:10.976811 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-60888d98-d174-4527-bf6a-5ce60b4e080c tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:10.977257 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-60888d98-d174-4527-bf6a-5ce60b4e080c tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:10.977726 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-60888d98-d174-4527-bf6a-5ce60b4e080c tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:10.978690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a8aec281-253c-4725-a449-a48c47b26fa0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:10.981122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a8aec281-253c-4725-a449-a48c47b26fa0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.236586 Aug 09 18:16:10.982509 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 61/112] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:10 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:11.115813 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-60888d98-d174-4527-bf6a-5ce60b4e080c tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:11.123485 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-60888d98-d174-4527-bf6a-5ce60b4e080c tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.160954 Aug 09 18:16:11.124052 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 52/113] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:10 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:11.981185 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b164295f-1c06-4654-bca5-b0a133eafae4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:11.981793 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-b164295f-1c06-4654-bca5-b0a133eafae4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:11.988149 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b164295f-1c06-4654-bca5-b0a133eafae4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:11.988877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b164295f-1c06-4654-bca5-b0a133eafae4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:11.989480 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b164295f-1c06-4654-bca5-b0a133eafae4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:11.990174 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b164295f-1c06-4654-bca5-b0a133eafae4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:11.990629 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b164295f-1c06-4654-bca5-b0a133eafae4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:11.991081 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b164295f-1c06-4654-bca5-b0a133eafae4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:12.009867 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=100 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:16:12.010816 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e04962f4-833d-4fb8-ad81-42a1342048f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:12.011422 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e04962f4-833d-4fb8-ad81-42a1342048f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:12.017440 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e04962f4-833d-4fb8-ad81-42a1342048f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:12.017943 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e04962f4-833d-4fb8-ad81-42a1342048f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:12.023853 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e04962f4-833d-4fb8-ad81-42a1342048f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:12.023853 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e04962f4-833d-4fb8-ad81-42a1342048f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:12.023853 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e04962f4-833d-4fb8-ad81-42a1342048f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:12.023853 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e04962f4-833d-4fb8-ad81-42a1342048f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:12.198205 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b164295f-1c06-4654-bca5-b0a133eafae4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:12.205859 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b164295f-1c06-4654-bca5-b0a133eafae4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.228358 Aug 09 18:16:12.206515 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 62/114] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:11 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:12.208950 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e04962f4-833d-4fb8-ad81-42a1342048f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:12.211815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-0abaaee0-3c2e-41ac-9c05-566b9b053361 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:12.212412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-0abaaee0-3c2e-41ac-9c05-566b9b053361 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:12.217990 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e04962f4-833d-4fb8-ad81-42a1342048f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:12.218265 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0abaaee0-3c2e-41ac-9c05-566b9b053361 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:12.218909 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0abaaee0-3c2e-41ac-9c05-566b9b053361 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:12.219322 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e04962f4-833d-4fb8-ad81-42a1342048f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:12.219463 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0abaaee0-3c2e-41ac-9c05-566b9b053361 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:12.220134 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0abaaee0-3c2e-41ac-9c05-566b9b053361 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:12.220598 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0abaaee0-3c2e-41ac-9c05-566b9b053361 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:12.220716 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e04962f4-833d-4fb8-ad81-42a1342048f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.214314 Aug 09 18:16:12.221024 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0abaaee0-3c2e-41ac-9c05-566b9b053361 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:12.221243 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 53/115] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:12 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:12.351405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-0abaaee0-3c2e-41ac-9c05-566b9b053361 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:12.358824 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-0abaaee0-3c2e-41ac-9c05-566b9b053361 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.150578 Aug 09 18:16:12.359387 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 63/116] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:12 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:13.227682 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-5249cede-a7d9-4ed2-9ea8-fd11a6e89f16 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:13.228313 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-5249cede-a7d9-4ed2-9ea8-fd11a6e89f16 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:13.234153 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5249cede-a7d9-4ed2-9ea8-fd11a6e89f16 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:13.234640 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5249cede-a7d9-4ed2-9ea8-fd11a6e89f16 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:13.235108 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5249cede-a7d9-4ed2-9ea8-fd11a6e89f16 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:13.235798 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5249cede-a7d9-4ed2-9ea8-fd11a6e89f16 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:13.236511 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5249cede-a7d9-4ed2-9ea8-fd11a6e89f16 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:13.236936 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5249cede-a7d9-4ed2-9ea8-fd11a6e89f16 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:13.244099 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f8cd72e6-78b8-4973-a528-322a312e9381 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:13.244711 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f8cd72e6-78b8-4973-a528-322a312e9381 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:13.250675 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8cd72e6-78b8-4973-a528-322a312e9381 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:13.251201 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8cd72e6-78b8-4973-a528-322a312e9381 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:13.251635 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8cd72e6-78b8-4973-a528-322a312e9381 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:13.252323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8cd72e6-78b8-4973-a528-322a312e9381 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:13.252770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8cd72e6-78b8-4973-a528-322a312e9381 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:13.253872 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8cd72e6-78b8-4973-a528-322a312e9381 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:13.446935 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-5249cede-a7d9-4ed2-9ea8-fd11a6e89f16 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:13.449871 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f8cd72e6-78b8-4973-a528-322a312e9381 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:13.458806 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-5249cede-a7d9-4ed2-9ea8-fd11a6e89f16 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.235052 Aug 09 18:16:13.459639 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 54/117] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:13 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:13.463906 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f8cd72e6-78b8-4973-a528-322a312e9381 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:13.465891 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f8cd72e6-78b8-4973-a528-322a312e9381 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:13.467431 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f8cd72e6-78b8-4973-a528-322a312e9381 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.227348 Aug 09 18:16:13.480189 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 64/118] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:13 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:16:13.482775 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d850d89c-27c3-46c4-9dc8-b7b6fe929dbb tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:13.482775 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d850d89c-27c3-46c4-9dc8-b7b6fe929dbb tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:13.490680 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d850d89c-27c3-46c4-9dc8-b7b6fe929dbb tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:13.491198 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d850d89c-27c3-46c4-9dc8-b7b6fe929dbb tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:13.491789 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d850d89c-27c3-46c4-9dc8-b7b6fe929dbb tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:13.492485 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d850d89c-27c3-46c4-9dc8-b7b6fe929dbb tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:13.492946 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d850d89c-27c3-46c4-9dc8-b7b6fe929dbb tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:13.493373 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d850d89c-27c3-46c4-9dc8-b7b6fe929dbb tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:13.631773 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d850d89c-27c3-46c4-9dc8-b7b6fe929dbb tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:13.639366 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d850d89c-27c3-46c4-9dc8-b7b6fe929dbb tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.169394 Aug 09 18:16:13.639936 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 55/119] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:13 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:14.485348 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-3fc46caa-9236-4cab-a8f7-722a6341f1b7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:14.488259 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-3fc46caa-9236-4cab-a8f7-722a6341f1b7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:14.492673 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3fc46caa-9236-4cab-a8f7-722a6341f1b7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:14.493209 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3fc46caa-9236-4cab-a8f7-722a6341f1b7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:14.493643 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3fc46caa-9236-4cab-a8f7-722a6341f1b7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:14.494440 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3fc46caa-9236-4cab-a8f7-722a6341f1b7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:14.494794 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3fc46caa-9236-4cab-a8f7-722a6341f1b7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:14.495218 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3fc46caa-9236-4cab-a8f7-722a6341f1b7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:14.500339 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-50f44f7c-3621-4b42-b450-d303ffbabdc1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:14.500895 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-50f44f7c-3621-4b42-b450-d303ffbabdc1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:14.509533 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-50f44f7c-3621-4b42-b450-d303ffbabdc1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:14.510576 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-50f44f7c-3621-4b42-b450-d303ffbabdc1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:14.511602 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-50f44f7c-3621-4b42-b450-d303ffbabdc1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:14.512989 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-50f44f7c-3621-4b42-b450-d303ffbabdc1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:14.516799 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-50f44f7c-3621-4b42-b450-d303ffbabdc1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:14.516799 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-50f44f7c-3621-4b42-b450-d303ffbabdc1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:14.537466 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=100 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:16:14.733329 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-3fc46caa-9236-4cab-a8f7-722a6341f1b7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:14.733838 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-50f44f7c-3621-4b42-b450-d303ffbabdc1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:14.745837 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-50f44f7c-3621-4b42-b450-d303ffbabdc1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:14.747334 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-3fc46caa-9236-4cab-a8f7-722a6341f1b7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.265665 Aug 09 18:16:14.755200 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 65/120] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:14 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:14.755522 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-50f44f7c-3621-4b42-b450-d303ffbabdc1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:14.755522 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-50f44f7c-3621-4b42-b450-d303ffbabdc1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.255149 Aug 09 18:16:14.755522 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 56/121] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:14 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:14.763481 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-72737191-ffbe-4a1b-b4e9-65cc23728d36 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:14.764093 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-72737191-ffbe-4a1b-b4e9-65cc23728d36 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:14.770302 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-72737191-ffbe-4a1b-b4e9-65cc23728d36 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:14.770858 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-72737191-ffbe-4a1b-b4e9-65cc23728d36 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:14.771310 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-72737191-ffbe-4a1b-b4e9-65cc23728d36 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:14.772006 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-72737191-ffbe-4a1b-b4e9-65cc23728d36 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:14.772467 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-72737191-ffbe-4a1b-b4e9-65cc23728d36 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:14.772891 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-72737191-ffbe-4a1b-b4e9-65cc23728d36 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:14.918519 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-72737191-ffbe-4a1b-b4e9-65cc23728d36 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:14.926537 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-72737191-ffbe-4a1b-b4e9-65cc23728d36 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.175857 Aug 09 18:16:14.927114 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 66/122] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:14 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:15.774137 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e37244d2-7732-4e73-9b49-7d8daa965ab4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:15.774137 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e37244d2-7732-4e73-9b49-7d8daa965ab4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:15.774699 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-ae40d90f-1d5e-4592-ba65-677319d09bf6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:15.774699 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-ae40d90f-1d5e-4592-ba65-677319d09bf6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:15.778791 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e37244d2-7732-4e73-9b49-7d8daa965ab4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:15.779314 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e37244d2-7732-4e73-9b49-7d8daa965ab4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:15.780026 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e37244d2-7732-4e73-9b49-7d8daa965ab4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:15.780897 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e37244d2-7732-4e73-9b49-7d8daa965ab4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:15.781482 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ae40d90f-1d5e-4592-ba65-677319d09bf6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:15.781612 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e37244d2-7732-4e73-9b49-7d8daa965ab4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:15.781944 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e37244d2-7732-4e73-9b49-7d8daa965ab4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:15.782590 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ae40d90f-1d5e-4592-ba65-677319d09bf6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:15.783227 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ae40d90f-1d5e-4592-ba65-677319d09bf6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:15.783931 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ae40d90f-1d5e-4592-ba65-677319d09bf6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:15.784547 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ae40d90f-1d5e-4592-ba65-677319d09bf6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:15.785292 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ae40d90f-1d5e-4592-ba65-677319d09bf6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:16.044460 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ae40d90f-1d5e-4592-ba65-677319d09bf6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:16.053449 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ae40d90f-1d5e-4592-ba65-677319d09bf6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:16.054816 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ae40d90f-1d5e-4592-ba65-677319d09bf6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:16.055950 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-ae40d90f-1d5e-4592-ba65-677319d09bf6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.286792 Aug 09 18:16:16.056606 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 67/123] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:15 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:16:16.071286 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9edb8906-feef-47fd-9601-3752b8768501 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:16.071959 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9edb8906-feef-47fd-9601-3752b8768501 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:16.077964 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9edb8906-feef-47fd-9601-3752b8768501 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:16.078656 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9edb8906-feef-47fd-9601-3752b8768501 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:16.079517 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9edb8906-feef-47fd-9601-3752b8768501 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:16.080709 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9edb8906-feef-47fd-9601-3752b8768501 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:16.081398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9edb8906-feef-47fd-9601-3752b8768501 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:16.082052 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9edb8906-feef-47fd-9601-3752b8768501 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:16.138190 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e37244d2-7732-4e73-9b49-7d8daa965ab4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:16.151716 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e37244d2-7732-4e73-9b49-7d8daa965ab4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.384205 Aug 09 18:16:16.152794 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 57/124] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:15 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:16.329722 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9edb8906-feef-47fd-9601-3752b8768501 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:16.338857 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9edb8906-feef-47fd-9601-3752b8768501 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.281235 Aug 09 18:16:16.344831 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 68/125] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:16 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:17.078821 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-81804c6a-a7a8-4693-8228-7e6784c82ab4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:17.079446 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-81804c6a-a7a8-4693-8228-7e6784c82ab4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:17.086129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-81804c6a-a7a8-4693-8228-7e6784c82ab4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:17.086622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-81804c6a-a7a8-4693-8228-7e6784c82ab4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:17.087085 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-81804c6a-a7a8-4693-8228-7e6784c82ab4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:17.087778 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-81804c6a-a7a8-4693-8228-7e6784c82ab4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:17.088262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-81804c6a-a7a8-4693-8228-7e6784c82ab4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:17.088679 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-81804c6a-a7a8-4693-8228-7e6784c82ab4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:17.173264 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e6ed08c3-634c-45c5-a574-f727f22c1ca9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:17.173920 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e6ed08c3-634c-45c5-a574-f727f22c1ca9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:17.181318 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e6ed08c3-634c-45c5-a574-f727f22c1ca9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:17.181817 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e6ed08c3-634c-45c5-a574-f727f22c1ca9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:17.182252 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e6ed08c3-634c-45c5-a574-f727f22c1ca9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:17.183159 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e6ed08c3-634c-45c5-a574-f727f22c1ca9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:17.183622 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e6ed08c3-634c-45c5-a574-f727f22c1ca9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:17.186733 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e6ed08c3-634c-45c5-a574-f727f22c1ca9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:17.232004 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-81804c6a-a7a8-4693-8228-7e6784c82ab4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:17.245507 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-81804c6a-a7a8-4693-8228-7e6784c82ab4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:17.247498 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-81804c6a-a7a8-4693-8228-7e6784c82ab4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:17.248883 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-81804c6a-a7a8-4693-8228-7e6784c82ab4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.175362 Aug 09 18:16:17.265559 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 58/126] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:17 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:16:17.342034 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e6ed08c3-634c-45c5-a574-f727f22c1ca9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:17.350278 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e6ed08c3-634c-45c5-a574-f727f22c1ca9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.180822 Aug 09 18:16:17.350861 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 69/127] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:17 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:17.360090 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-156dfa04-5b2a-45c3-8534-16cb76ad84d9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:17.360703 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-156dfa04-5b2a-45c3-8534-16cb76ad84d9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:17.366834 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-156dfa04-5b2a-45c3-8534-16cb76ad84d9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:17.367318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-156dfa04-5b2a-45c3-8534-16cb76ad84d9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:17.367746 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-156dfa04-5b2a-45c3-8534-16cb76ad84d9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:17.368516 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-156dfa04-5b2a-45c3-8534-16cb76ad84d9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:17.368881 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-156dfa04-5b2a-45c3-8534-16cb76ad84d9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:17.369303 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-156dfa04-5b2a-45c3-8534-16cb76ad84d9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:17.506013 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-156dfa04-5b2a-45c3-8534-16cb76ad84d9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:17.513632 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-156dfa04-5b2a-45c3-8534-16cb76ad84d9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.157190 Aug 09 18:16:17.514205 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 59/128] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:17 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:18.272776 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-7dee36a7-51ff-47c9-89d5-62db90e84989 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:18.273463 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-7dee36a7-51ff-47c9-89d5-62db90e84989 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:18.279402 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7dee36a7-51ff-47c9-89d5-62db90e84989 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:18.279968 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7dee36a7-51ff-47c9-89d5-62db90e84989 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:18.280465 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7dee36a7-51ff-47c9-89d5-62db90e84989 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:18.281216 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7dee36a7-51ff-47c9-89d5-62db90e84989 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:18.281723 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7dee36a7-51ff-47c9-89d5-62db90e84989 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:18.282203 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7dee36a7-51ff-47c9-89d5-62db90e84989 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:18.376286 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-31027ed6-00f6-4913-a5ea-b79dccf5cdba tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:18.376898 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-31027ed6-00f6-4913-a5ea-b79dccf5cdba tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:18.385274 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-31027ed6-00f6-4913-a5ea-b79dccf5cdba tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:18.386758 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-31027ed6-00f6-4913-a5ea-b79dccf5cdba tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:18.387618 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-31027ed6-00f6-4913-a5ea-b79dccf5cdba tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:18.388772 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-31027ed6-00f6-4913-a5ea-b79dccf5cdba tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:18.389390 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-31027ed6-00f6-4913-a5ea-b79dccf5cdba tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:18.389974 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-31027ed6-00f6-4913-a5ea-b79dccf5cdba tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:18.420447 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-7dee36a7-51ff-47c9-89d5-62db90e84989 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:18.433922 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-7dee36a7-51ff-47c9-89d5-62db90e84989 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:18.435583 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-7dee36a7-51ff-47c9-89d5-62db90e84989 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:18.436784 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-7dee36a7-51ff-47c9-89d5-62db90e84989 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.168075 Aug 09 18:16:18.438831 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 70/129] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:18 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:16:18.535207 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c3a8f71c-b1eb-4685-b6bc-4b03f6737649 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:18.535934 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-c3a8f71c-b1eb-4685-b6bc-4b03f6737649 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:18.540533 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-31027ed6-00f6-4913-a5ea-b79dccf5cdba tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:18.542889 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c3a8f71c-b1eb-4685-b6bc-4b03f6737649 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:18.543455 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c3a8f71c-b1eb-4685-b6bc-4b03f6737649 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:18.543960 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c3a8f71c-b1eb-4685-b6bc-4b03f6737649 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:18.544964 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c3a8f71c-b1eb-4685-b6bc-4b03f6737649 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:18.545506 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c3a8f71c-b1eb-4685-b6bc-4b03f6737649 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:18.546002 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c3a8f71c-b1eb-4685-b6bc-4b03f6737649 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:18.548245 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-31027ed6-00f6-4913-a5ea-b79dccf5cdba tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.175743 Aug 09 18:16:18.548819 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 60/130] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:18 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:18.681866 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-c3a8f71c-b1eb-4685-b6bc-4b03f6737649 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:18.689469 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-c3a8f71c-b1eb-4685-b6bc-4b03f6737649 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.158138 Aug 09 18:16:18.690035 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 71/131] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:18 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:19.466730 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-78b55643-2e70-4b5b-87b1-7cc94c41bbcc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:19.467478 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-78b55643-2e70-4b5b-87b1-7cc94c41bbcc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:19.473564 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-78b55643-2e70-4b5b-87b1-7cc94c41bbcc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:19.474058 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-78b55643-2e70-4b5b-87b1-7cc94c41bbcc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:19.475203 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-78b55643-2e70-4b5b-87b1-7cc94c41bbcc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:19.476036 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-78b55643-2e70-4b5b-87b1-7cc94c41bbcc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:19.476535 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-78b55643-2e70-4b5b-87b1-7cc94c41bbcc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:19.476958 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-78b55643-2e70-4b5b-87b1-7cc94c41bbcc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:19.570699 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-514f3e02-c95f-4c7f-a16e-49409fa134e0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:19.571336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-514f3e02-c95f-4c7f-a16e-49409fa134e0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:19.577474 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-514f3e02-c95f-4c7f-a16e-49409fa134e0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:19.578152 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-514f3e02-c95f-4c7f-a16e-49409fa134e0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:19.578575 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-514f3e02-c95f-4c7f-a16e-49409fa134e0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:19.579523 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-514f3e02-c95f-4c7f-a16e-49409fa134e0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:19.580310 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-514f3e02-c95f-4c7f-a16e-49409fa134e0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:19.580759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-514f3e02-c95f-4c7f-a16e-49409fa134e0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:19.669233 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-78b55643-2e70-4b5b-87b1-7cc94c41bbcc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:19.680644 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-78b55643-2e70-4b5b-87b1-7cc94c41bbcc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:19.682454 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-78b55643-2e70-4b5b-87b1-7cc94c41bbcc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:19.683609 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-78b55643-2e70-4b5b-87b1-7cc94c41bbcc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.223929 Aug 09 18:16:19.684505 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 61/132] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:19 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:16:19.715309 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-7d9cde93-f942-4371-a2f5-9cae9d78bef3 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:19.716007 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-7d9cde93-f942-4371-a2f5-9cae9d78bef3 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:19.721955 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7d9cde93-f942-4371-a2f5-9cae9d78bef3 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:19.722440 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7d9cde93-f942-4371-a2f5-9cae9d78bef3 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:19.722914 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7d9cde93-f942-4371-a2f5-9cae9d78bef3 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:19.723784 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7d9cde93-f942-4371-a2f5-9cae9d78bef3 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:19.724391 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7d9cde93-f942-4371-a2f5-9cae9d78bef3 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:19.728741 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7d9cde93-f942-4371-a2f5-9cae9d78bef3 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:19.746247 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-514f3e02-c95f-4c7f-a16e-49409fa134e0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:19.756199 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-514f3e02-c95f-4c7f-a16e-49409fa134e0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.190485 Aug 09 18:16:19.757105 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 72/133] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:19 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:19.890884 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-0dd6cd93-f0aa-4448-9d61-e3b234c58c06 req-c06f5e49-a1d5-407e-8da4-2fcda12eec14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e0ec306-6457-418d-8cd7-b86df41c026b", "name": "network-vif-plugged", "status": "completed", "tag": "c00a6107-22ea-4149-ae88-6b763c07baf9"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:16:19.891888 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-7d9cde93-f942-4371-a2f5-9cae9d78bef3 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:19.900405 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-7d9cde93-f942-4371-a2f5-9cae9d78bef3 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.189063 Aug 09 18:16:19.900863 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-0dd6cd93-f0aa-4448-9d61-e3b234c58c06 req-c06f5e49-a1d5-407e-8da4-2fcda12eec14 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:19.901285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 62/134] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:19 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:19.901397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-0dd6cd93-f0aa-4448-9d61-e3b234c58c06 req-c06f5e49-a1d5-407e-8da4-2fcda12eec14 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:19.901793 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-0dd6cd93-f0aa-4448-9d61-e3b234c58c06 req-c06f5e49-a1d5-407e-8da4-2fcda12eec14 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:19.914210 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-0dd6cd93-f0aa-4448-9d61-e3b234c58c06 req-c06f5e49-a1d5-407e-8da4-2fcda12eec14 service nova] Creating event network-vif-plugged:c00a6107-22ea-4149-ae88-6b763c07baf9 for instance 2e0ec306-6457-418d-8cd7-b86df41c026b on hv-cinder-79797 Aug 09 18:16:19.920036 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-0dd6cd93-f0aa-4448-9d61-e3b234c58c06 req-c06f5e49-a1d5-407e-8da4-2fcda12eec14 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087258 Aug 09 18:16:19.920629 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 73/135] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:16:20.706218 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-bd471bff-24ce-4fbe-9485-da0b97c00dfc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:20.706766 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-bd471bff-24ce-4fbe-9485-da0b97c00dfc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:20.713147 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bd471bff-24ce-4fbe-9485-da0b97c00dfc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:20.713638 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bd471bff-24ce-4fbe-9485-da0b97c00dfc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:20.714074 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bd471bff-24ce-4fbe-9485-da0b97c00dfc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:20.714877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bd471bff-24ce-4fbe-9485-da0b97c00dfc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:20.715320 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bd471bff-24ce-4fbe-9485-da0b97c00dfc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:20.715739 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bd471bff-24ce-4fbe-9485-da0b97c00dfc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:20.777994 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a685b8f1-b4c7-4941-a6ef-851cda2a937f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:20.779567 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a685b8f1-b4c7-4941-a6ef-851cda2a937f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:20.785959 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a685b8f1-b4c7-4941-a6ef-851cda2a937f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:20.786602 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a685b8f1-b4c7-4941-a6ef-851cda2a937f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:20.787247 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a685b8f1-b4c7-4941-a6ef-851cda2a937f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:20.788213 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a685b8f1-b4c7-4941-a6ef-851cda2a937f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:20.789492 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a685b8f1-b4c7-4941-a6ef-851cda2a937f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:20.790095 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a685b8f1-b4c7-4941-a6ef-851cda2a937f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:20.936233 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-bd471bff-24ce-4fbe-9485-da0b97c00dfc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:20.944109 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-bd471bff-24ce-4fbe-9485-da0b97c00dfc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:20.946153 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-bd471bff-24ce-4fbe-9485-da0b97c00dfc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:20.947292 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-bd471bff-24ce-4fbe-9485-da0b97c00dfc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.245420 Aug 09 18:16:20.947851 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 63/136] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:20 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:16:20.952375 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-90bb674c-f028-455d-a932-72203b9542d9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:20.952982 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-90bb674c-f028-455d-a932-72203b9542d9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:20.959080 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-90bb674c-f028-455d-a932-72203b9542d9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:20.959600 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-90bb674c-f028-455d-a932-72203b9542d9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:20.960035 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-90bb674c-f028-455d-a932-72203b9542d9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:20.961312 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-90bb674c-f028-455d-a932-72203b9542d9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:20.961968 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-90bb674c-f028-455d-a932-72203b9542d9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:20.962575 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-90bb674c-f028-455d-a932-72203b9542d9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:20.978650 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a685b8f1-b4c7-4941-a6ef-851cda2a937f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:20.986758 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a685b8f1-b4c7-4941-a6ef-851cda2a937f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.213152 Aug 09 18:16:20.987322 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 74/137] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:20 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:21.098358 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-90bb674c-f028-455d-a932-72203b9542d9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:21.106330 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-90bb674c-f028-455d-a932-72203b9542d9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.157413 Aug 09 18:16:21.113725 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 64/138] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:20 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:21.971245 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-898426ca-d60f-4fef-afc1-e22570b90568 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:21.971759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-898426ca-d60f-4fef-afc1-e22570b90568 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:21.977765 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-898426ca-d60f-4fef-afc1-e22570b90568 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:21.978298 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-898426ca-d60f-4fef-afc1-e22570b90568 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:21.978831 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-898426ca-d60f-4fef-afc1-e22570b90568 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:21.979515 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-898426ca-d60f-4fef-afc1-e22570b90568 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:21.979972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-898426ca-d60f-4fef-afc1-e22570b90568 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:21.980411 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-898426ca-d60f-4fef-afc1-e22570b90568 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:22.009037 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-1bd6a174-824f-4fd2-b588-bfa3b714d6cf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:22.009639 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-1bd6a174-824f-4fd2-b588-bfa3b714d6cf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:22.025827 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1bd6a174-824f-4fd2-b588-bfa3b714d6cf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:22.026543 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1bd6a174-824f-4fd2-b588-bfa3b714d6cf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:22.027041 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1bd6a174-824f-4fd2-b588-bfa3b714d6cf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:22.027796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1bd6a174-824f-4fd2-b588-bfa3b714d6cf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:22.028156 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1bd6a174-824f-4fd2-b588-bfa3b714d6cf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:22.028802 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1bd6a174-824f-4fd2-b588-bfa3b714d6cf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:22.177256 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-898426ca-d60f-4fef-afc1-e22570b90568 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:22.186882 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-898426ca-d60f-4fef-afc1-e22570b90568 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:22.188519 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-898426ca-d60f-4fef-afc1-e22570b90568 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:22.189498 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-898426ca-d60f-4fef-afc1-e22570b90568 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.222389 Aug 09 18:16:22.193505 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 75/139] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:21 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:16:22.213808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-06fc54f7-9736-4b2d-8cdc-3a46415fd1c7 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:22.214799 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-06fc54f7-9736-4b2d-8cdc-3a46415fd1c7 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:22.221046 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-06fc54f7-9736-4b2d-8cdc-3a46415fd1c7 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:22.226849 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-06fc54f7-9736-4b2d-8cdc-3a46415fd1c7 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:22.226849 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-06fc54f7-9736-4b2d-8cdc-3a46415fd1c7 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:22.226849 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-06fc54f7-9736-4b2d-8cdc-3a46415fd1c7 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:22.226849 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-06fc54f7-9736-4b2d-8cdc-3a46415fd1c7 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:22.227298 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-06fc54f7-9736-4b2d-8cdc-3a46415fd1c7 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:22.227434 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-1bd6a174-824f-4fd2-b588-bfa3b714d6cf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:22.233606 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-1bd6a174-824f-4fd2-b588-bfa3b714d6cf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.229011 Aug 09 18:16:22.234187 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 65/140] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:22 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:22.371038 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-06fc54f7-9736-4b2d-8cdc-3a46415fd1c7 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:22.381795 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-06fc54f7-9736-4b2d-8cdc-3a46415fd1c7 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.173283 Aug 09 18:16:22.382590 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 76/141] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:22 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:23.219789 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-0b4b7b6f-8b44-4b28-9a27-8a3e3a2631cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:23.220388 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-0b4b7b6f-8b44-4b28-9a27-8a3e3a2631cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:23.227197 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0b4b7b6f-8b44-4b28-9a27-8a3e3a2631cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:23.228442 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0b4b7b6f-8b44-4b28-9a27-8a3e3a2631cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:23.228908 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0b4b7b6f-8b44-4b28-9a27-8a3e3a2631cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:23.229676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0b4b7b6f-8b44-4b28-9a27-8a3e3a2631cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:23.230327 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0b4b7b6f-8b44-4b28-9a27-8a3e3a2631cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:23.230781 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0b4b7b6f-8b44-4b28-9a27-8a3e3a2631cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:23.256361 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-ad3cf5f7-58ef-47e5-81c1-0ba12c6d971e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:23.256970 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-ad3cf5f7-58ef-47e5-81c1-0ba12c6d971e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:23.263285 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ad3cf5f7-58ef-47e5-81c1-0ba12c6d971e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:23.263887 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ad3cf5f7-58ef-47e5-81c1-0ba12c6d971e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:23.264381 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ad3cf5f7-58ef-47e5-81c1-0ba12c6d971e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:23.265306 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ad3cf5f7-58ef-47e5-81c1-0ba12c6d971e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:23.265818 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ad3cf5f7-58ef-47e5-81c1-0ba12c6d971e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:23.266344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ad3cf5f7-58ef-47e5-81c1-0ba12c6d971e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:23.441752 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-0b4b7b6f-8b44-4b28-9a27-8a3e3a2631cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:23.444984 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ad3cf5f7-58ef-47e5-81c1-0ba12c6d971e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:23.458795 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-0b4b7b6f-8b44-4b28-9a27-8a3e3a2631cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:23.460307 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-0b4b7b6f-8b44-4b28-9a27-8a3e3a2631cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:23.461408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-0b4b7b6f-8b44-4b28-9a27-8a3e3a2631cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.245526 Aug 09 18:16:23.462510 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 66/142] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:23 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:23.466050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-ad3cf5f7-58ef-47e5-81c1-0ba12c6d971e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.213226 Aug 09 18:16:23.467099 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 77/143] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:23 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:23.474505 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f605b0d6-660e-4263-8aa8-148dd07835bf tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:23.475279 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f605b0d6-660e-4263-8aa8-148dd07835bf tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:23.484810 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f605b0d6-660e-4263-8aa8-148dd07835bf tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:23.485504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f605b0d6-660e-4263-8aa8-148dd07835bf tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:23.486293 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f605b0d6-660e-4263-8aa8-148dd07835bf tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:23.487118 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f605b0d6-660e-4263-8aa8-148dd07835bf tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:23.487632 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f605b0d6-660e-4263-8aa8-148dd07835bf tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:23.488116 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f605b0d6-660e-4263-8aa8-148dd07835bf tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:23.627834 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f605b0d6-660e-4263-8aa8-148dd07835bf tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:23.636822 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f605b0d6-660e-4263-8aa8-148dd07835bf tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.173211 Aug 09 18:16:23.637631 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 67/144] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:23 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:24.484453 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-cb39296c-e8b1-4452-886b-6f52041b9f0e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:24.485052 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-cb39296c-e8b1-4452-886b-6f52041b9f0e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:24.491290 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cb39296c-e8b1-4452-886b-6f52041b9f0e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:24.491768 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cb39296c-e8b1-4452-886b-6f52041b9f0e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:24.492195 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cb39296c-e8b1-4452-886b-6f52041b9f0e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:24.492775 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e034e0c1-07cd-4347-b086-ecd849984c82 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:24.494476 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cb39296c-e8b1-4452-886b-6f52041b9f0e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:24.494578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e034e0c1-07cd-4347-b086-ecd849984c82 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:24.494663 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cb39296c-e8b1-4452-886b-6f52041b9f0e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:24.494663 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cb39296c-e8b1-4452-886b-6f52041b9f0e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:24.500262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e034e0c1-07cd-4347-b086-ecd849984c82 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:24.500751 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e034e0c1-07cd-4347-b086-ecd849984c82 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:24.501222 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e034e0c1-07cd-4347-b086-ecd849984c82 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:24.501915 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e034e0c1-07cd-4347-b086-ecd849984c82 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:24.502370 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e034e0c1-07cd-4347-b086-ecd849984c82 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:24.502819 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e034e0c1-07cd-4347-b086-ecd849984c82 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:24.701872 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-cb39296c-e8b1-4452-886b-6f52041b9f0e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:24.705140 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e034e0c1-07cd-4347-b086-ecd849984c82 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:24.718614 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e034e0c1-07cd-4347-b086-ecd849984c82 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.229753 Aug 09 18:16:24.718799 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-cb39296c-e8b1-4452-886b-6f52041b9f0e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:24.719523 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 68/145] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:24 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:24.720343 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-cb39296c-e8b1-4452-886b-6f52041b9f0e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:24.721748 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-cb39296c-e8b1-4452-886b-6f52041b9f0e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.241142 Aug 09 18:16:24.722542 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 78/146] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:24 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:16:24.724433 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-1033938f-7699-4eaa-bca7-1959744f911d tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:24.725204 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-1033938f-7699-4eaa-bca7-1959744f911d tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:24.731893 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1033938f-7699-4eaa-bca7-1959744f911d tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:24.732376 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1033938f-7699-4eaa-bca7-1959744f911d tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:24.732973 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1033938f-7699-4eaa-bca7-1959744f911d tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:24.733733 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1033938f-7699-4eaa-bca7-1959744f911d tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:24.734197 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1033938f-7699-4eaa-bca7-1959744f911d tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:24.734616 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1033938f-7699-4eaa-bca7-1959744f911d tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:24.881879 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-1033938f-7699-4eaa-bca7-1959744f911d tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:24.890611 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-1033938f-7699-4eaa-bca7-1959744f911d tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.169911 Aug 09 18:16:24.891242 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 69/147] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:24 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:25.740355 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-54788c27-cb53-469d-ae63-eaf094ed68e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:25.741062 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-54788c27-cb53-469d-ae63-eaf094ed68e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:25.746394 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f6485aa0-62ab-40b2-bc10-32b3cc4a8835 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:25.747524 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f6485aa0-62ab-40b2-bc10-32b3cc4a8835 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:25.751518 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-54788c27-cb53-469d-ae63-eaf094ed68e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:25.752011 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-54788c27-cb53-469d-ae63-eaf094ed68e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:25.752438 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-54788c27-cb53-469d-ae63-eaf094ed68e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:25.753539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-54788c27-cb53-469d-ae63-eaf094ed68e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:25.754117 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-54788c27-cb53-469d-ae63-eaf094ed68e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:25.754230 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f6485aa0-62ab-40b2-bc10-32b3cc4a8835 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:25.754718 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f6485aa0-62ab-40b2-bc10-32b3cc4a8835 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:25.754946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-54788c27-cb53-469d-ae63-eaf094ed68e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:25.755305 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f6485aa0-62ab-40b2-bc10-32b3cc4a8835 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:25.755993 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f6485aa0-62ab-40b2-bc10-32b3cc4a8835 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:25.756460 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f6485aa0-62ab-40b2-bc10-32b3cc4a8835 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:25.756863 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f6485aa0-62ab-40b2-bc10-32b3cc4a8835 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:26.005028 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-54788c27-cb53-469d-ae63-eaf094ed68e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:26.009073 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=100 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:16:26.014768 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f6485aa0-62ab-40b2-bc10-32b3cc4a8835 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:26.044360 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-54788c27-cb53-469d-ae63-eaf094ed68e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.293308 Aug 09 18:16:26.044360 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 79/148] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:25 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:26.044616 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f6485aa0-62ab-40b2-bc10-32b3cc4a8835 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:26.044616 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f6485aa0-62ab-40b2-bc10-32b3cc4a8835 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:26.044800 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-0ed02540-5c37-4527-8216-400c72472773 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:26.044879 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f6485aa0-62ab-40b2-bc10-32b3cc4a8835 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.294650 Aug 09 18:16:26.044949 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-0ed02540-5c37-4527-8216-400c72472773 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:26.045016 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 70/149] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:25 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:16:26.045089 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0ed02540-5c37-4527-8216-400c72472773 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:26.045089 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0ed02540-5c37-4527-8216-400c72472773 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:26.045089 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0ed02540-5c37-4527-8216-400c72472773 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:26.045397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0ed02540-5c37-4527-8216-400c72472773 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:26.045862 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0ed02540-5c37-4527-8216-400c72472773 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:26.046825 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0ed02540-5c37-4527-8216-400c72472773 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:26.191230 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-0ed02540-5c37-4527-8216-400c72472773 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:26.200582 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-0ed02540-5c37-4527-8216-400c72472773 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.168921 Aug 09 18:16:26.201973 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 80/150] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:26 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:27.058558 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-45234941-e47d-4b0f-9f82-7fa2890e56ad tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:27.059718 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-45234941-e47d-4b0f-9f82-7fa2890e56ad tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:27.062741 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-11de7ade-42ed-4639-a6ff-4bf578cbfa3e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:27.063362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-11de7ade-42ed-4639-a6ff-4bf578cbfa3e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:27.065860 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-45234941-e47d-4b0f-9f82-7fa2890e56ad tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:27.066343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-45234941-e47d-4b0f-9f82-7fa2890e56ad tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:27.066800 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-45234941-e47d-4b0f-9f82-7fa2890e56ad tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:27.067487 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-45234941-e47d-4b0f-9f82-7fa2890e56ad tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:27.067938 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-45234941-e47d-4b0f-9f82-7fa2890e56ad tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:27.068353 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-45234941-e47d-4b0f-9f82-7fa2890e56ad tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:27.072163 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-11de7ade-42ed-4639-a6ff-4bf578cbfa3e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:27.072713 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-11de7ade-42ed-4639-a6ff-4bf578cbfa3e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:27.073161 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-11de7ade-42ed-4639-a6ff-4bf578cbfa3e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:27.075062 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-11de7ade-42ed-4639-a6ff-4bf578cbfa3e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:27.076139 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-11de7ade-42ed-4639-a6ff-4bf578cbfa3e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:27.076756 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-11de7ade-42ed-4639-a6ff-4bf578cbfa3e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:27.273522 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-45234941-e47d-4b0f-9f82-7fa2890e56ad tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:27.281458 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-45234941-e47d-4b0f-9f82-7fa2890e56ad tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.228913 Aug 09 18:16:27.282511 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 71/151] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:27 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:27.286603 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-175ee899-5d3d-4d40-9e9b-bebb251d8521 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:27.287237 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-175ee899-5d3d-4d40-9e9b-bebb251d8521 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:27.293433 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-175ee899-5d3d-4d40-9e9b-bebb251d8521 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:27.293919 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-175ee899-5d3d-4d40-9e9b-bebb251d8521 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:27.294349 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-175ee899-5d3d-4d40-9e9b-bebb251d8521 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:27.295228 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-175ee899-5d3d-4d40-9e9b-bebb251d8521 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:27.295683 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-175ee899-5d3d-4d40-9e9b-bebb251d8521 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:27.295971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-11de7ade-42ed-4639-a6ff-4bf578cbfa3e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:27.296086 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-175ee899-5d3d-4d40-9e9b-bebb251d8521 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:27.303969 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-11de7ade-42ed-4639-a6ff-4bf578cbfa3e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:27.305484 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-11de7ade-42ed-4639-a6ff-4bf578cbfa3e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:27.307011 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-11de7ade-42ed-4639-a6ff-4bf578cbfa3e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.249139 Aug 09 18:16:27.307568 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 81/152] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:27 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:16:27.424633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-175ee899-5d3d-4d40-9e9b-bebb251d8521 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:27.432536 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-175ee899-5d3d-4d40-9e9b-bebb251d8521 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.149570 Aug 09 18:16:27.433119 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 72/153] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:27 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:28.303846 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a62912be-3db0-4580-b72e-1bb99c604451 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:28.304540 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a62912be-3db0-4580-b72e-1bb99c604451 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:28.312068 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a62912be-3db0-4580-b72e-1bb99c604451 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:28.312563 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a62912be-3db0-4580-b72e-1bb99c604451 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:28.312997 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a62912be-3db0-4580-b72e-1bb99c604451 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:28.313696 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a62912be-3db0-4580-b72e-1bb99c604451 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:28.314153 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a62912be-3db0-4580-b72e-1bb99c604451 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:28.314576 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a62912be-3db0-4580-b72e-1bb99c604451 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:28.329502 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-657dab22-fbde-408b-a78e-2316dc51e5c5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:28.330104 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-657dab22-fbde-408b-a78e-2316dc51e5c5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:28.336458 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-657dab22-fbde-408b-a78e-2316dc51e5c5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:28.337607 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-657dab22-fbde-408b-a78e-2316dc51e5c5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:28.338037 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-657dab22-fbde-408b-a78e-2316dc51e5c5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:28.338733 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-657dab22-fbde-408b-a78e-2316dc51e5c5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:28.339248 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-657dab22-fbde-408b-a78e-2316dc51e5c5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:28.339666 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-657dab22-fbde-408b-a78e-2316dc51e5c5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:28.344719 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=100 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:16:28.518019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a62912be-3db0-4580-b72e-1bb99c604451 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:28.524994 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-657dab22-fbde-408b-a78e-2316dc51e5c5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:28.526365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a62912be-3db0-4580-b72e-1bb99c604451 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.226433 Aug 09 18:16:28.526973 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 82/154] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:28 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:28.532297 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-23e7f24b-e226-4118-9d7b-9b7a7685fc11 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:28.533005 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-23e7f24b-e226-4118-9d7b-9b7a7685fc11 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:28.533814 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-657dab22-fbde-408b-a78e-2316dc51e5c5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:28.535369 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-657dab22-fbde-408b-a78e-2316dc51e5c5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:28.538512 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-657dab22-fbde-408b-a78e-2316dc51e5c5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.211068 Aug 09 18:16:28.538512 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 73/155] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:28 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:28.539078 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-23e7f24b-e226-4118-9d7b-9b7a7685fc11 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:28.540235 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-23e7f24b-e226-4118-9d7b-9b7a7685fc11 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:28.540677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-23e7f24b-e226-4118-9d7b-9b7a7685fc11 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:28.541367 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-23e7f24b-e226-4118-9d7b-9b7a7685fc11 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:28.541814 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-23e7f24b-e226-4118-9d7b-9b7a7685fc11 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:28.542228 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-23e7f24b-e226-4118-9d7b-9b7a7685fc11 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:28.672261 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-23e7f24b-e226-4118-9d7b-9b7a7685fc11 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:28.679696 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-23e7f24b-e226-4118-9d7b-9b7a7685fc11 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.151620 Aug 09 18:16:28.680285 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 83/156] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:28 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:29.168143 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-d4d335a8-1b85-4d73-b0fa-7553e9e6ab3d req-ba6bd8a6-87f3-4d55-8c94-cfbc5e825880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d6f4e3-a426-423e-960e-05c7bac110c9", "name": "network-vif-plugged", "status": "completed", "tag": "537d9a41-70d0-468a-aa6e-efa9b91a431a"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:16:29.178383 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-d4d335a8-1b85-4d73-b0fa-7553e9e6ab3d req-ba6bd8a6-87f3-4d55-8c94-cfbc5e825880 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:29.178957 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-d4d335a8-1b85-4d73-b0fa-7553e9e6ab3d req-ba6bd8a6-87f3-4d55-8c94-cfbc5e825880 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:29.179329 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-d4d335a8-1b85-4d73-b0fa-7553e9e6ab3d req-ba6bd8a6-87f3-4d55-8c94-cfbc5e825880 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:29.191341 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-d4d335a8-1b85-4d73-b0fa-7553e9e6ab3d req-ba6bd8a6-87f3-4d55-8c94-cfbc5e825880 service nova] Creating event network-vif-plugged:537d9a41-70d0-468a-aa6e-efa9b91a431a for instance 67d6f4e3-a426-423e-960e-05c7bac110c9 on hv-cinder-79797 Aug 09 18:16:29.197000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-d4d335a8-1b85-4d73-b0fa-7553e9e6ab3d req-ba6bd8a6-87f3-4d55-8c94-cfbc5e825880 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032958 Aug 09 18:16:29.197605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 74/157] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:16:29.548375 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-8b47eae9-74f6-4d78-81bb-f7b0ee21f6b6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:29.549010 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-8b47eae9-74f6-4d78-81bb-f7b0ee21f6b6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:29.555534 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8b47eae9-74f6-4d78-81bb-f7b0ee21f6b6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:29.556269 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8b47eae9-74f6-4d78-81bb-f7b0ee21f6b6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:29.556707 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8b47eae9-74f6-4d78-81bb-f7b0ee21f6b6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:29.557404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8b47eae9-74f6-4d78-81bb-f7b0ee21f6b6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:29.557859 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8b47eae9-74f6-4d78-81bb-f7b0ee21f6b6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:29.558287 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8b47eae9-74f6-4d78-81bb-f7b0ee21f6b6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:29.561587 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-767ca2c2-fbf8-4b63-84b8-1f3714c54d99 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:29.562284 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-767ca2c2-fbf8-4b63-84b8-1f3714c54d99 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:29.568447 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-767ca2c2-fbf8-4b63-84b8-1f3714c54d99 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:29.568924 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-767ca2c2-fbf8-4b63-84b8-1f3714c54d99 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:29.569350 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-767ca2c2-fbf8-4b63-84b8-1f3714c54d99 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:29.570175 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-767ca2c2-fbf8-4b63-84b8-1f3714c54d99 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:29.570615 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-767ca2c2-fbf8-4b63-84b8-1f3714c54d99 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:29.571651 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-767ca2c2-fbf8-4b63-84b8-1f3714c54d99 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:29.755483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-8b47eae9-74f6-4d78-81bb-f7b0ee21f6b6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:29.763584 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-8b47eae9-74f6-4d78-81bb-f7b0ee21f6b6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.218885 Aug 09 18:16:29.768931 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-767ca2c2-fbf8-4b63-84b8-1f3714c54d99 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:29.770366 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 84/158] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:29 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:29.782875 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-767ca2c2-fbf8-4b63-84b8-1f3714c54d99 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:29.782875 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-767ca2c2-fbf8-4b63-84b8-1f3714c54d99 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:29.782875 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-767ca2c2-fbf8-4b63-84b8-1f3714c54d99 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.221134 Aug 09 18:16:29.783328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 75/159] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:29 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:29.784323 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-942e756c-a39a-4c01-8f95-94896b8a2498 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:29.784484 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-942e756c-a39a-4c01-8f95-94896b8a2498 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:29.792244 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-942e756c-a39a-4c01-8f95-94896b8a2498 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:29.792737 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-942e756c-a39a-4c01-8f95-94896b8a2498 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:29.793171 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-942e756c-a39a-4c01-8f95-94896b8a2498 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:29.794048 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-942e756c-a39a-4c01-8f95-94896b8a2498 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:29.794510 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-942e756c-a39a-4c01-8f95-94896b8a2498 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:29.794969 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-942e756c-a39a-4c01-8f95-94896b8a2498 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:29.928952 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-942e756c-a39a-4c01-8f95-94896b8a2498 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:29.936682 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-942e756c-a39a-4c01-8f95-94896b8a2498 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.156680 Aug 09 18:16:29.937254 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 76/160] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:29 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:30.791284 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e48f2971-dc67-47ba-9964-373b348d38b3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:30.791887 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e48f2971-dc67-47ba-9964-373b348d38b3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:30.798640 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e48f2971-dc67-47ba-9964-373b348d38b3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:30.799158 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e48f2971-dc67-47ba-9964-373b348d38b3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:30.799596 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e48f2971-dc67-47ba-9964-373b348d38b3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:30.800283 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e48f2971-dc67-47ba-9964-373b348d38b3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:30.800734 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e48f2971-dc67-47ba-9964-373b348d38b3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:30.801153 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e48f2971-dc67-47ba-9964-373b348d38b3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:30.801410 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f0a504b0-6ef2-44f9-a5be-f9cefc3af6c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:30.802011 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f0a504b0-6ef2-44f9-a5be-f9cefc3af6c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:30.808505 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f0a504b0-6ef2-44f9-a5be-f9cefc3af6c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:30.809012 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f0a504b0-6ef2-44f9-a5be-f9cefc3af6c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:30.809440 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f0a504b0-6ef2-44f9-a5be-f9cefc3af6c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:30.810122 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f0a504b0-6ef2-44f9-a5be-f9cefc3af6c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:30.810666 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f0a504b0-6ef2-44f9-a5be-f9cefc3af6c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:30.811129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f0a504b0-6ef2-44f9-a5be-f9cefc3af6c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:30.997854 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e48f2971-dc67-47ba-9964-373b348d38b3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:31.002102 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f0a504b0-6ef2-44f9-a5be-f9cefc3af6c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:31.005320 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e48f2971-dc67-47ba-9964-373b348d38b3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.217880 Aug 09 18:16:31.005888 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 85/161] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:30 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:31.010786 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b11f11f7-0851-4466-8c9d-793b60fc84c4 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:31.010917 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f0a504b0-6ef2-44f9-a5be-f9cefc3af6c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:31.011397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-b11f11f7-0851-4466-8c9d-793b60fc84c4 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:31.012458 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f0a504b0-6ef2-44f9-a5be-f9cefc3af6c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:31.013520 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f0a504b0-6ef2-44f9-a5be-f9cefc3af6c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.215926 Aug 09 18:16:31.014486 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 77/162] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:30 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:16:31.020839 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b11f11f7-0851-4466-8c9d-793b60fc84c4 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:31.021261 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b11f11f7-0851-4466-8c9d-793b60fc84c4 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:31.021681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b11f11f7-0851-4466-8c9d-793b60fc84c4 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:31.022362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b11f11f7-0851-4466-8c9d-793b60fc84c4 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:31.022834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b11f11f7-0851-4466-8c9d-793b60fc84c4 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:31.023252 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b11f11f7-0851-4466-8c9d-793b60fc84c4 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:31.152081 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b11f11f7-0851-4466-8c9d-793b60fc84c4 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:31.159672 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b11f11f7-0851-4466-8c9d-793b60fc84c4 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.152824 Aug 09 18:16:31.160252 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 86/163] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:31 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:32.027452 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f2c20cbf-415d-4ebb-bb69-312a5261c323 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:32.028052 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f2c20cbf-415d-4ebb-bb69-312a5261c323 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:32.033947 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f2c20cbf-415d-4ebb-bb69-312a5261c323 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:32.034421 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f2c20cbf-415d-4ebb-bb69-312a5261c323 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:32.034886 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f2c20cbf-415d-4ebb-bb69-312a5261c323 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:32.035564 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f2c20cbf-415d-4ebb-bb69-312a5261c323 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:32.036010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f2c20cbf-415d-4ebb-bb69-312a5261c323 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:32.036139 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-20b53471-d9b3-4437-8213-d0ffa2d557a8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:32.036535 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f2c20cbf-415d-4ebb-bb69-312a5261c323 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:32.036668 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-20b53471-d9b3-4437-8213-d0ffa2d557a8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:32.042419 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-20b53471-d9b3-4437-8213-d0ffa2d557a8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:32.042933 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-20b53471-d9b3-4437-8213-d0ffa2d557a8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:32.043369 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-20b53471-d9b3-4437-8213-d0ffa2d557a8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:32.044046 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-20b53471-d9b3-4437-8213-d0ffa2d557a8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:32.044500 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-20b53471-d9b3-4437-8213-d0ffa2d557a8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:32.044917 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-20b53471-d9b3-4437-8213-d0ffa2d557a8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:32.238619 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-20b53471-d9b3-4437-8213-d0ffa2d557a8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:32.241944 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f2c20cbf-415d-4ebb-bb69-312a5261c323 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:32.247645 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-20b53471-d9b3-4437-8213-d0ffa2d557a8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:32.249189 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-20b53471-d9b3-4437-8213-d0ffa2d557a8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:32.250295 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-20b53471-d9b3-4437-8213-d0ffa2d557a8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.218089 Aug 09 18:16:32.250741 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f2c20cbf-415d-4ebb-bb69-312a5261c323 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.227798 Aug 09 18:16:32.250854 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 87/164] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:32 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:32.251945 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 78/165] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:32 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:32.255319 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-22b496c2-28bb-4480-92ae-c89b390c3103 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:32.255921 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-22b496c2-28bb-4480-92ae-c89b390c3103 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:32.262281 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-22b496c2-28bb-4480-92ae-c89b390c3103 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:32.262946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-22b496c2-28bb-4480-92ae-c89b390c3103 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:32.263249 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-22b496c2-28bb-4480-92ae-c89b390c3103 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:32.263941 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-22b496c2-28bb-4480-92ae-c89b390c3103 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:32.264456 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-22b496c2-28bb-4480-92ae-c89b390c3103 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:32.264882 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-22b496c2-28bb-4480-92ae-c89b390c3103 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:32.394226 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-22b496c2-28bb-4480-92ae-c89b390c3103 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:32.402233 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-22b496c2-28bb-4480-92ae-c89b390c3103 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.150258 Aug 09 18:16:32.402880 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 88/166] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:32 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:33.272089 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-cdd2134b-c577-4907-a3d7-bf9036065490 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:33.272695 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-cdd2134b-c577-4907-a3d7-bf9036065490 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:33.273245 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a899eb50-13eb-4eeb-80b3-2ca75a21fe79 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:33.273886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a899eb50-13eb-4eeb-80b3-2ca75a21fe79 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:33.274640 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=70 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:16:33.280248 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=77 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:16:33.281394 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cdd2134b-c577-4907-a3d7-bf9036065490 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:33.281907 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cdd2134b-c577-4907-a3d7-bf9036065490 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:33.282284 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a899eb50-13eb-4eeb-80b3-2ca75a21fe79 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:33.282509 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cdd2134b-c577-4907-a3d7-bf9036065490 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:33.283200 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a899eb50-13eb-4eeb-80b3-2ca75a21fe79 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:33.283400 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cdd2134b-c577-4907-a3d7-bf9036065490 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:33.283638 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a899eb50-13eb-4eeb-80b3-2ca75a21fe79 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:33.283755 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cdd2134b-c577-4907-a3d7-bf9036065490 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:33.284101 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cdd2134b-c577-4907-a3d7-bf9036065490 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:33.284444 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a899eb50-13eb-4eeb-80b3-2ca75a21fe79 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:33.285221 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a899eb50-13eb-4eeb-80b3-2ca75a21fe79 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:33.285793 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a899eb50-13eb-4eeb-80b3-2ca75a21fe79 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:33.486528 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-cdd2134b-c577-4907-a3d7-bf9036065490 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:33.490598 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a899eb50-13eb-4eeb-80b3-2ca75a21fe79 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:33.494098 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-cdd2134b-c577-4907-a3d7-bf9036065490 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.225871 Aug 09 18:16:33.494738 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 79/167] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:33 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:33.506852 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c3c8c7c9-a0f5-4a13-b318-423a9c4f9509 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:33.506852 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c3c8c7c9-a0f5-4a13-b318-423a9c4f9509 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:33.514887 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a899eb50-13eb-4eeb-80b3-2ca75a21fe79 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:33.514887 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a899eb50-13eb-4eeb-80b3-2ca75a21fe79 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:33.514887 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a899eb50-13eb-4eeb-80b3-2ca75a21fe79 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.233780 Aug 09 18:16:33.515118 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 89/168] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:33 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:33.515186 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c3c8c7c9-a0f5-4a13-b318-423a9c4f9509 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:33.515186 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c3c8c7c9-a0f5-4a13-b318-423a9c4f9509 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:33.515186 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c3c8c7c9-a0f5-4a13-b318-423a9c4f9509 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:33.515186 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c3c8c7c9-a0f5-4a13-b318-423a9c4f9509 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:33.515443 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c3c8c7c9-a0f5-4a13-b318-423a9c4f9509 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:33.515443 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c3c8c7c9-a0f5-4a13-b318-423a9c4f9509 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:33.643857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c3c8c7c9-a0f5-4a13-b318-423a9c4f9509 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:33.652162 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c3c8c7c9-a0f5-4a13-b318-423a9c4f9509 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.154908 Aug 09 18:16:33.652883 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 80/169] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:33 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:34.517271 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-66eb5833-e4ec-4e5b-97a4-8b4f6270b574 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:34.517877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-66eb5833-e4ec-4e5b-97a4-8b4f6270b574 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:34.523997 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-66eb5833-e4ec-4e5b-97a4-8b4f6270b574 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:34.524477 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-66eb5833-e4ec-4e5b-97a4-8b4f6270b574 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:34.524908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-66eb5833-e4ec-4e5b-97a4-8b4f6270b574 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:34.525587 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-66eb5833-e4ec-4e5b-97a4-8b4f6270b574 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:34.526121 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-66eb5833-e4ec-4e5b-97a4-8b4f6270b574 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:34.526589 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-66eb5833-e4ec-4e5b-97a4-8b4f6270b574 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:34.536401 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d9b731a1-4e40-4e1f-8b8e-1c0decfdf167 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:34.537008 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d9b731a1-4e40-4e1f-8b8e-1c0decfdf167 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:34.543077 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d9b731a1-4e40-4e1f-8b8e-1c0decfdf167 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:34.543566 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d9b731a1-4e40-4e1f-8b8e-1c0decfdf167 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:34.544225 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d9b731a1-4e40-4e1f-8b8e-1c0decfdf167 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:34.544944 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d9b731a1-4e40-4e1f-8b8e-1c0decfdf167 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:34.545551 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d9b731a1-4e40-4e1f-8b8e-1c0decfdf167 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:34.546156 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d9b731a1-4e40-4e1f-8b8e-1c0decfdf167 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:34.728196 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-66eb5833-e4ec-4e5b-97a4-8b4f6270b574 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:34.731600 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d9b731a1-4e40-4e1f-8b8e-1c0decfdf167 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:34.736039 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-66eb5833-e4ec-4e5b-97a4-8b4f6270b574 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.222724 Aug 09 18:16:34.736601 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 90/170] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:34 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:34.739850 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d9b731a1-4e40-4e1f-8b8e-1c0decfdf167 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:34.740975 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-62c19ada-3de5-4005-826d-3f09e96f2a7e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:34.741396 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d9b731a1-4e40-4e1f-8b8e-1c0decfdf167 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:34.741563 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-62c19ada-3de5-4005-826d-3f09e96f2a7e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:34.743681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d9b731a1-4e40-4e1f-8b8e-1c0decfdf167 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.210157 Aug 09 18:16:34.748879 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-62c19ada-3de5-4005-826d-3f09e96f2a7e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:34.749362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-62c19ada-3de5-4005-826d-3f09e96f2a7e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:34.749788 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-62c19ada-3de5-4005-826d-3f09e96f2a7e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:34.750466 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-62c19ada-3de5-4005-826d-3f09e96f2a7e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:34.750718 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 81/171] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:34 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:34.750946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-62c19ada-3de5-4005-826d-3f09e96f2a7e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:34.751357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-62c19ada-3de5-4005-826d-3f09e96f2a7e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:34.887446 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-62c19ada-3de5-4005-826d-3f09e96f2a7e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:34.894815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-62c19ada-3de5-4005-826d-3f09e96f2a7e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.157269 Aug 09 18:16:34.895514 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 91/172] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:34 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:35.757476 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e51c955b-de85-40ac-8e1e-c955a3940af6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:35.758109 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e51c955b-de85-40ac-8e1e-c955a3940af6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:35.764707 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e51c955b-de85-40ac-8e1e-c955a3940af6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:35.765193 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e51c955b-de85-40ac-8e1e-c955a3940af6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:35.765814 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e51c955b-de85-40ac-8e1e-c955a3940af6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:35.766582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e51c955b-de85-40ac-8e1e-c955a3940af6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:35.767081 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e51c955b-de85-40ac-8e1e-c955a3940af6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:35.771008 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e51c955b-de85-40ac-8e1e-c955a3940af6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:35.771154 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-7b24564a-baf5-45ac-9f27-e4adef836c9e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:35.771154 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-7b24564a-baf5-45ac-9f27-e4adef836c9e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:35.775250 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7b24564a-baf5-45ac-9f27-e4adef836c9e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:35.775726 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7b24564a-baf5-45ac-9f27-e4adef836c9e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:35.776160 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7b24564a-baf5-45ac-9f27-e4adef836c9e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:35.776835 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7b24564a-baf5-45ac-9f27-e4adef836c9e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:35.778345 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7b24564a-baf5-45ac-9f27-e4adef836c9e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:35.778790 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7b24564a-baf5-45ac-9f27-e4adef836c9e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:35.972022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e51c955b-de85-40ac-8e1e-c955a3940af6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:35.974909 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-7b24564a-baf5-45ac-9f27-e4adef836c9e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:35.979591 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e51c955b-de85-40ac-8e1e-c955a3940af6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.226005 Aug 09 18:16:35.980165 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 82/173] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:35 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:35.984104 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-7b24564a-baf5-45ac-9f27-e4adef836c9e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:35.990223 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-aa182177-2349-4501-af58-dd8f4aa420b4 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:35.990223 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-aa182177-2349-4501-af58-dd8f4aa420b4 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:35.990429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-7b24564a-baf5-45ac-9f27-e4adef836c9e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:35.990429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-7b24564a-baf5-45ac-9f27-e4adef836c9e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.223043 Aug 09 18:16:35.990429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 92/174] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:35 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:35.991766 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aa182177-2349-4501-af58-dd8f4aa420b4 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:35.992247 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aa182177-2349-4501-af58-dd8f4aa420b4 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:35.992677 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aa182177-2349-4501-af58-dd8f4aa420b4 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:35.993544 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aa182177-2349-4501-af58-dd8f4aa420b4 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:35.994155 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aa182177-2349-4501-af58-dd8f4aa420b4 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:35.994757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aa182177-2349-4501-af58-dd8f4aa420b4 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:36.125515 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-aa182177-2349-4501-af58-dd8f4aa420b4 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:36.132942 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-aa182177-2349-4501-af58-dd8f4aa420b4 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.151811 Aug 09 18:16:36.133504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 83/175] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:35 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:37.002205 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d4cc2422-b29e-4fd7-9986-b6dc6be4279c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:37.003051 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d4cc2422-b29e-4fd7-9986-b6dc6be4279c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:37.008961 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d4cc2422-b29e-4fd7-9986-b6dc6be4279c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:37.009527 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d4cc2422-b29e-4fd7-9986-b6dc6be4279c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:37.010032 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d4cc2422-b29e-4fd7-9986-b6dc6be4279c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:37.010821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d4cc2422-b29e-4fd7-9986-b6dc6be4279c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:37.011872 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d4cc2422-b29e-4fd7-9986-b6dc6be4279c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:37.012166 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-1ab48bf4-71c7-4a62-a090-905089cce92f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:37.012635 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d4cc2422-b29e-4fd7-9986-b6dc6be4279c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:37.013287 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-1ab48bf4-71c7-4a62-a090-905089cce92f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:37.019363 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1ab48bf4-71c7-4a62-a090-905089cce92f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:37.019927 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1ab48bf4-71c7-4a62-a090-905089cce92f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:37.020435 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1ab48bf4-71c7-4a62-a090-905089cce92f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:37.021203 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1ab48bf4-71c7-4a62-a090-905089cce92f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:37.021761 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1ab48bf4-71c7-4a62-a090-905089cce92f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:37.022323 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1ab48bf4-71c7-4a62-a090-905089cce92f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:37.234199 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d4cc2422-b29e-4fd7-9986-b6dc6be4279c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:37.238467 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-1ab48bf4-71c7-4a62-a090-905089cce92f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:37.242172 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d4cc2422-b29e-4fd7-9986-b6dc6be4279c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.243860 Aug 09 18:16:37.242973 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 93/176] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:36 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:37.247651 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-cc70fa9d-b624-4632-9b29-492678fa08a3 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:37.248489 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-cc70fa9d-b624-4632-9b29-492678fa08a3 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:37.249434 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-1ab48bf4-71c7-4a62-a090-905089cce92f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:37.251117 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-1ab48bf4-71c7-4a62-a090-905089cce92f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:37.252219 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-1ab48bf4-71c7-4a62-a090-905089cce92f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.245045 Aug 09 18:16:37.252777 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 84/177] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:37 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:37.254888 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc70fa9d-b624-4632-9b29-492678fa08a3 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:37.255487 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc70fa9d-b624-4632-9b29-492678fa08a3 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:37.256042 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc70fa9d-b624-4632-9b29-492678fa08a3 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:37.256929 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc70fa9d-b624-4632-9b29-492678fa08a3 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:37.257383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc70fa9d-b624-4632-9b29-492678fa08a3 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:37.257815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc70fa9d-b624-4632-9b29-492678fa08a3 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:37.394448 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-cc70fa9d-b624-4632-9b29-492678fa08a3 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:37.402229 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-cc70fa9d-b624-4632-9b29-492678fa08a3 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.158212 Aug 09 18:16:37.402888 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 94/178] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:37 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:38.264529 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-a1ef3292-f8a6-44c8-abe4-12bf6e40c5c4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:38.265053 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-a1ef3292-f8a6-44c8-abe4-12bf6e40c5c4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:38.270908 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a1ef3292-f8a6-44c8-abe4-12bf6e40c5c4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:38.271449 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a1ef3292-f8a6-44c8-abe4-12bf6e40c5c4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:38.271823 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a1ef3292-f8a6-44c8-abe4-12bf6e40c5c4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:38.272513 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a1ef3292-f8a6-44c8-abe4-12bf6e40c5c4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:38.272965 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a1ef3292-f8a6-44c8-abe4-12bf6e40c5c4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:38.273387 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a1ef3292-f8a6-44c8-abe4-12bf6e40c5c4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:38.277318 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-267466db-463d-4a7e-81dd-853d4e3d78dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:38.278102 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-267466db-463d-4a7e-81dd-853d4e3d78dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:38.283913 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-267466db-463d-4a7e-81dd-853d4e3d78dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:38.284391 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-267466db-463d-4a7e-81dd-853d4e3d78dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:38.284817 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-267466db-463d-4a7e-81dd-853d4e3d78dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:38.285497 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-267466db-463d-4a7e-81dd-853d4e3d78dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:38.285945 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-267466db-463d-4a7e-81dd-853d4e3d78dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:38.286357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-267466db-463d-4a7e-81dd-853d4e3d78dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:38.608927 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a1ef3292-f8a6-44c8-abe4-12bf6e40c5c4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:38.616641 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-a1ef3292-f8a6-44c8-abe4-12bf6e40c5c4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.356146 Aug 09 18:16:38.617210 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 85/179] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:38 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:38.624694 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-98542dd9-6110-431b-a8de-53474255a792 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:38.624694 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-98542dd9-6110-431b-a8de-53474255a792 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:38.625603 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-267466db-463d-4a7e-81dd-853d4e3d78dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:38.628333 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-98542dd9-6110-431b-a8de-53474255a792 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:38.628816 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-98542dd9-6110-431b-a8de-53474255a792 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:38.629244 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-98542dd9-6110-431b-a8de-53474255a792 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:38.630122 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-98542dd9-6110-431b-a8de-53474255a792 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:38.630573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-98542dd9-6110-431b-a8de-53474255a792 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:38.631028 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-98542dd9-6110-431b-a8de-53474255a792 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:38.634077 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-267466db-463d-4a7e-81dd-853d4e3d78dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:38.635723 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-267466db-463d-4a7e-81dd-853d4e3d78dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:38.637402 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-267466db-463d-4a7e-81dd-853d4e3d78dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.364393 Aug 09 18:16:38.638041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 95/180] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:38 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:38.757658 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-98542dd9-6110-431b-a8de-53474255a792 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:38.765634 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-98542dd9-6110-431b-a8de-53474255a792 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.147475 Aug 09 18:16:38.766193 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 86/181] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:38 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:39.637807 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6aee60cf-fd74-41a5-8421-9b5d14444a8e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:39.638414 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-6aee60cf-fd74-41a5-8421-9b5d14444a8e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:39.644332 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6aee60cf-fd74-41a5-8421-9b5d14444a8e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:39.644816 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6aee60cf-fd74-41a5-8421-9b5d14444a8e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:39.645250 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6aee60cf-fd74-41a5-8421-9b5d14444a8e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:39.645932 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6aee60cf-fd74-41a5-8421-9b5d14444a8e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:39.646386 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6aee60cf-fd74-41a5-8421-9b5d14444a8e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:39.646877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6aee60cf-fd74-41a5-8421-9b5d14444a8e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:39.660114 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f1fb2f51-36ba-4c6e-905d-b404520e032a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:39.660837 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f1fb2f51-36ba-4c6e-905d-b404520e032a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:39.665020 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=100 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:16:39.666780 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f1fb2f51-36ba-4c6e-905d-b404520e032a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:39.667283 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f1fb2f51-36ba-4c6e-905d-b404520e032a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:39.667877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f1fb2f51-36ba-4c6e-905d-b404520e032a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:39.668730 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f1fb2f51-36ba-4c6e-905d-b404520e032a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:39.669178 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f1fb2f51-36ba-4c6e-905d-b404520e032a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:39.669595 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f1fb2f51-36ba-4c6e-905d-b404520e032a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:39.839449 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6aee60cf-fd74-41a5-8421-9b5d14444a8e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:39.847456 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-6aee60cf-fd74-41a5-8421-9b5d14444a8e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.213963 Aug 09 18:16:39.849544 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 96/182] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:39 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:39.850994 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f1fb2f51-36ba-4c6e-905d-b404520e032a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:39.854333 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-97d8321c-dcd2-487e-ba53-852b5bb7d7ee tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:39.855315 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-97d8321c-dcd2-487e-ba53-852b5bb7d7ee tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:39.859702 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f1fb2f51-36ba-4c6e-905d-b404520e032a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:39.861463 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-97d8321c-dcd2-487e-ba53-852b5bb7d7ee tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:39.861598 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f1fb2f51-36ba-4c6e-905d-b404520e032a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:39.861956 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-97d8321c-dcd2-487e-ba53-852b5bb7d7ee tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:39.862384 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-97d8321c-dcd2-487e-ba53-852b5bb7d7ee tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:39.862552 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f1fb2f51-36ba-4c6e-905d-b404520e032a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.206303 Aug 09 18:16:39.863093 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-97d8321c-dcd2-487e-ba53-852b5bb7d7ee tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:39.863224 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 87/183] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:39 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:39.863679 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-97d8321c-dcd2-487e-ba53-852b5bb7d7ee tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:39.864103 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-97d8321c-dcd2-487e-ba53-852b5bb7d7ee tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:39.996249 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-97d8321c-dcd2-487e-ba53-852b5bb7d7ee tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:40.004060 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-97d8321c-dcd2-487e-ba53-852b5bb7d7ee tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.153359 Aug 09 18:16:40.004624 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 97/184] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:39 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:40.868586 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-b638bc95-a582-47ec-9cac-afd8001a62b0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:40.869337 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-b638bc95-a582-47ec-9cac-afd8001a62b0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:40.876207 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b638bc95-a582-47ec-9cac-afd8001a62b0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:40.876696 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b638bc95-a582-47ec-9cac-afd8001a62b0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:40.877131 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b638bc95-a582-47ec-9cac-afd8001a62b0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:40.877827 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b638bc95-a582-47ec-9cac-afd8001a62b0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:40.878285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b638bc95-a582-47ec-9cac-afd8001a62b0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:40.878735 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b638bc95-a582-47ec-9cac-afd8001a62b0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:40.885417 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-ae010ca7-da7f-4ea7-96ae-e853bbd734d7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:40.888206 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-ae010ca7-da7f-4ea7-96ae-e853bbd734d7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:40.894044 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ae010ca7-da7f-4ea7-96ae-e853bbd734d7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:40.894534 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ae010ca7-da7f-4ea7-96ae-e853bbd734d7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:40.895004 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ae010ca7-da7f-4ea7-96ae-e853bbd734d7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:40.895694 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ae010ca7-da7f-4ea7-96ae-e853bbd734d7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:40.896146 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ae010ca7-da7f-4ea7-96ae-e853bbd734d7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:40.896562 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ae010ca7-da7f-4ea7-96ae-e853bbd734d7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:41.091928 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ae010ca7-da7f-4ea7-96ae-e853bbd734d7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:41.094737 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-b638bc95-a582-47ec-9cac-afd8001a62b0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:41.101449 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ae010ca7-da7f-4ea7-96ae-e853bbd734d7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:41.102273 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-b638bc95-a582-47ec-9cac-afd8001a62b0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.237541 Aug 09 18:16:41.102933 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 88/185] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:40 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:41.103057 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ae010ca7-da7f-4ea7-96ae-e853bbd734d7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:41.104136 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-ae010ca7-da7f-4ea7-96ae-e853bbd734d7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.222511 Aug 09 18:16:41.108395 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-5d59679e-f857-4395-ab40-390eef3bffc0 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:41.109362 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-5d59679e-f857-4395-ab40-390eef3bffc0 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:41.115338 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 98/186] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:40 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:41.116308 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d59679e-f857-4395-ab40-390eef3bffc0 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:41.136926 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d59679e-f857-4395-ab40-390eef3bffc0 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:41.136926 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d59679e-f857-4395-ab40-390eef3bffc0 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:41.136926 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d59679e-f857-4395-ab40-390eef3bffc0 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:41.136926 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d59679e-f857-4395-ab40-390eef3bffc0 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:41.137311 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d59679e-f857-4395-ab40-390eef3bffc0 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:41.196971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-7e357f28-defb-48ca-8f0d-d08d4ff4817c req-25373a52-715f-449b-8dd7-7fffcbc9ec16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55a70796-1659-4326-8c40-f33454bc848c", "name": "network-vif-plugged", "status": "completed", "tag": "a941d35f-e7c7-4b47-8838-e16dd1d6f978"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:16:41.207906 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-7e357f28-defb-48ca-8f0d-d08d4ff4817c req-25373a52-715f-449b-8dd7-7fffcbc9ec16 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:41.208395 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-7e357f28-defb-48ca-8f0d-d08d4ff4817c req-25373a52-715f-449b-8dd7-7fffcbc9ec16 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:41.208827 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-7e357f28-defb-48ca-8f0d-d08d4ff4817c req-25373a52-715f-449b-8dd7-7fffcbc9ec16 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:41.222150 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-7e357f28-defb-48ca-8f0d-d08d4ff4817c req-25373a52-715f-449b-8dd7-7fffcbc9ec16 service nova] Creating event network-vif-plugged:a941d35f-e7c7-4b47-8838-e16dd1d6f978 for instance 55a70796-1659-4326-8c40-f33454bc848c on hv-cinder-79797 Aug 09 18:16:41.227569 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-7e357f28-defb-48ca-8f0d-d08d4ff4817c req-25373a52-715f-449b-8dd7-7fffcbc9ec16 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034293 Aug 09 18:16:41.228154 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 99/187] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:16:41.259150 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-5d59679e-f857-4395-ab40-390eef3bffc0 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:41.269856 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-5d59679e-f857-4395-ab40-390eef3bffc0 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.164757 Aug 09 18:16:41.270833 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 89/188] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:41 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:42.124746 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-83cd35ec-f8a3-4136-95b2-55858589ce99 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:42.126100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-83cd35ec-f8a3-4136-95b2-55858589ce99 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:42.126919 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-a6bce7cb-5483-4231-9c90-2759345ba9db tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:42.127555 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-a6bce7cb-5483-4231-9c90-2759345ba9db tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:42.132587 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-83cd35ec-f8a3-4136-95b2-55858589ce99 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:42.133074 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-83cd35ec-f8a3-4136-95b2-55858589ce99 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:42.133448 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a6bce7cb-5483-4231-9c90-2759345ba9db tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:42.133571 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-83cd35ec-f8a3-4136-95b2-55858589ce99 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:42.133925 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a6bce7cb-5483-4231-9c90-2759345ba9db tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:42.134179 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-83cd35ec-f8a3-4136-95b2-55858589ce99 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:42.134355 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a6bce7cb-5483-4231-9c90-2759345ba9db tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:42.134629 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-83cd35ec-f8a3-4136-95b2-55858589ce99 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:42.135096 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a6bce7cb-5483-4231-9c90-2759345ba9db tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:42.135200 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-83cd35ec-f8a3-4136-95b2-55858589ce99 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:42.135538 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a6bce7cb-5483-4231-9c90-2759345ba9db tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:42.135960 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a6bce7cb-5483-4231-9c90-2759345ba9db tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:42.155571 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=100 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:16:42.357690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-83cd35ec-f8a3-4136-95b2-55858589ce99 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:42.361483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a6bce7cb-5483-4231-9c90-2759345ba9db tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:42.366040 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-83cd35ec-f8a3-4136-95b2-55858589ce99 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.245906 Aug 09 18:16:42.366801 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 100/189] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:42 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:42.372507 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f8bb297b-f757-49e0-9f36-8f71a16d4b0a tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:42.373295 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f8bb297b-f757-49e0-9f36-8f71a16d4b0a tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:42.379127 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a6bce7cb-5483-4231-9c90-2759345ba9db tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:42.384581 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8bb297b-f757-49e0-9f36-8f71a16d4b0a tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:42.384581 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8bb297b-f757-49e0-9f36-8f71a16d4b0a tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:42.384581 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8bb297b-f757-49e0-9f36-8f71a16d4b0a tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:42.384581 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8bb297b-f757-49e0-9f36-8f71a16d4b0a tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:42.385119 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a6bce7cb-5483-4231-9c90-2759345ba9db tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:42.385229 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8bb297b-f757-49e0-9f36-8f71a16d4b0a tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:42.385229 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8bb297b-f757-49e0-9f36-8f71a16d4b0a tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:42.385383 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-a6bce7cb-5483-4231-9c90-2759345ba9db tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.259041 Aug 09 18:16:42.385383 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 90/190] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:42 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:42.595721 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f8bb297b-f757-49e0-9f36-8f71a16d4b0a tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:42.614100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f8bb297b-f757-49e0-9f36-8f71a16d4b0a tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.245503 Aug 09 18:16:42.614948 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 101/191] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:42 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:43.391374 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-6217a959-8258-42a3-bfb0-4e78ceb83060 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:43.391994 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-6217a959-8258-42a3-bfb0-4e78ceb83060 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:43.397876 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6217a959-8258-42a3-bfb0-4e78ceb83060 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:43.398367 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6217a959-8258-42a3-bfb0-4e78ceb83060 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:43.400228 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6217a959-8258-42a3-bfb0-4e78ceb83060 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:43.400228 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6217a959-8258-42a3-bfb0-4e78ceb83060 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:43.400228 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6217a959-8258-42a3-bfb0-4e78ceb83060 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:43.400635 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6217a959-8258-42a3-bfb0-4e78ceb83060 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:43.407903 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-fa4e7954-8c1d-4a72-a4d6-9c40a56e10f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:43.408578 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-fa4e7954-8c1d-4a72-a4d6-9c40a56e10f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:43.415735 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fa4e7954-8c1d-4a72-a4d6-9c40a56e10f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:43.416305 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fa4e7954-8c1d-4a72-a4d6-9c40a56e10f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:43.416958 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fa4e7954-8c1d-4a72-a4d6-9c40a56e10f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:43.419543 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fa4e7954-8c1d-4a72-a4d6-9c40a56e10f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:43.420352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fa4e7954-8c1d-4a72-a4d6-9c40a56e10f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:43.420867 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fa4e7954-8c1d-4a72-a4d6-9c40a56e10f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:43.605398 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-6217a959-8258-42a3-bfb0-4e78ceb83060 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:43.613448 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-6217a959-8258-42a3-bfb0-4e78ceb83060 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.226040 Aug 09 18:16:43.614274 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 91/192] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:43 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:43.616991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-fa4e7954-8c1d-4a72-a4d6-9c40a56e10f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:43.625447 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-fa4e7954-8c1d-4a72-a4d6-9c40a56e10f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:43.627044 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-fa4e7954-8c1d-4a72-a4d6-9c40a56e10f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:43.628198 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-fa4e7954-8c1d-4a72-a4d6-9c40a56e10f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.225757 Aug 09 18:16:43.628838 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 102/193] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:43 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:16:43.637480 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-24ce19b0-a276-4e64-ad67-510bf6ac23aa tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:43.638084 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-24ce19b0-a276-4e64-ad67-510bf6ac23aa tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:43.644110 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-24ce19b0-a276-4e64-ad67-510bf6ac23aa tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:43.644591 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-24ce19b0-a276-4e64-ad67-510bf6ac23aa tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:43.645024 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-24ce19b0-a276-4e64-ad67-510bf6ac23aa tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:43.645705 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-24ce19b0-a276-4e64-ad67-510bf6ac23aa tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:43.646157 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-24ce19b0-a276-4e64-ad67-510bf6ac23aa tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:43.646580 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-24ce19b0-a276-4e64-ad67-510bf6ac23aa tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:43.775123 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-24ce19b0-a276-4e64-ad67-510bf6ac23aa tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:43.782662 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-24ce19b0-a276-4e64-ad67-510bf6ac23aa tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.149507 Aug 09 18:16:43.783240 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 92/194] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:43 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:44.637839 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-1a634c62-fc4c-4452-b1c2-0da2d1064d43 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:44.638436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-1a634c62-fc4c-4452-b1c2-0da2d1064d43 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:44.644385 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1a634c62-fc4c-4452-b1c2-0da2d1064d43 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:44.646364 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1a634c62-fc4c-4452-b1c2-0da2d1064d43 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:44.646364 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1a634c62-fc4c-4452-b1c2-0da2d1064d43 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:44.646364 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1a634c62-fc4c-4452-b1c2-0da2d1064d43 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:44.646364 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1a634c62-fc4c-4452-b1c2-0da2d1064d43 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:44.646793 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1a634c62-fc4c-4452-b1c2-0da2d1064d43 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:44.652035 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c6971445-8a6d-4572-bad4-392c0bcd926d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:44.652716 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c6971445-8a6d-4572-bad4-392c0bcd926d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:44.658473 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c6971445-8a6d-4572-bad4-392c0bcd926d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:44.658981 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c6971445-8a6d-4572-bad4-392c0bcd926d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:44.659409 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c6971445-8a6d-4572-bad4-392c0bcd926d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:44.660085 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c6971445-8a6d-4572-bad4-392c0bcd926d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:44.660530 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c6971445-8a6d-4572-bad4-392c0bcd926d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:44.660941 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c6971445-8a6d-4572-bad4-392c0bcd926d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:44.845156 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-1a634c62-fc4c-4452-b1c2-0da2d1064d43 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:44.849071 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c6971445-8a6d-4572-bad4-392c0bcd926d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:44.852481 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-1a634c62-fc4c-4452-b1c2-0da2d1064d43 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.219549 Aug 09 18:16:44.853048 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 103/195] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:44 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:44.857190 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c6971445-8a6d-4572-bad4-392c0bcd926d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:44.857990 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-dac5963d-6a77-4a23-bfc7-21efd1649b00 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:44.858622 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-dac5963d-6a77-4a23-bfc7-21efd1649b00 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:44.858879 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c6971445-8a6d-4572-bad4-392c0bcd926d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:44.860214 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c6971445-8a6d-4572-bad4-392c0bcd926d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.212329 Aug 09 18:16:44.860727 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 93/196] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:44 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:16:44.864756 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dac5963d-6a77-4a23-bfc7-21efd1649b00 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:44.865336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dac5963d-6a77-4a23-bfc7-21efd1649b00 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:44.865863 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dac5963d-6a77-4a23-bfc7-21efd1649b00 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:44.866642 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dac5963d-6a77-4a23-bfc7-21efd1649b00 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:44.867123 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dac5963d-6a77-4a23-bfc7-21efd1649b00 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:44.867545 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dac5963d-6a77-4a23-bfc7-21efd1649b00 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:45.002221 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-dac5963d-6a77-4a23-bfc7-21efd1649b00 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:45.009678 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-dac5963d-6a77-4a23-bfc7-21efd1649b00 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.155635 Aug 09 18:16:45.010166 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 104/197] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:44 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:45.873943 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-27146eee-3c78-4c5c-b068-8edd97a2f1b9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:45.874600 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-27146eee-3c78-4c5c-b068-8edd97a2f1b9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:45.882041 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-27146eee-3c78-4c5c-b068-8edd97a2f1b9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:45.882225 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-8cb7dd74-9806-487e-948b-dcff53bf3cb1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:45.882624 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-27146eee-3c78-4c5c-b068-8edd97a2f1b9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:45.882931 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-8cb7dd74-9806-487e-948b-dcff53bf3cb1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:45.883029 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-27146eee-3c78-4c5c-b068-8edd97a2f1b9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:45.883623 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-27146eee-3c78-4c5c-b068-8edd97a2f1b9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:45.884068 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-27146eee-3c78-4c5c-b068-8edd97a2f1b9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:45.884485 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-27146eee-3c78-4c5c-b068-8edd97a2f1b9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:45.889041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8cb7dd74-9806-487e-948b-dcff53bf3cb1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:45.889590 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8cb7dd74-9806-487e-948b-dcff53bf3cb1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:45.890086 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8cb7dd74-9806-487e-948b-dcff53bf3cb1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:45.890801 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8cb7dd74-9806-487e-948b-dcff53bf3cb1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:45.891248 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8cb7dd74-9806-487e-948b-dcff53bf3cb1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:45.891664 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8cb7dd74-9806-487e-948b-dcff53bf3cb1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:46.080405 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-27146eee-3c78-4c5c-b068-8edd97a2f1b9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:46.083680 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-8cb7dd74-9806-487e-948b-dcff53bf3cb1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:46.087852 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-27146eee-3c78-4c5c-b068-8edd97a2f1b9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.218420 Aug 09 18:16:46.088409 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 94/198] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:45 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:46.092366 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-8cb7dd74-9806-487e-948b-dcff53bf3cb1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:46.093401 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e96b9bbd-3ce1-4644-8b17-42886629db72 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:46.093994 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e96b9bbd-3ce1-4644-8b17-42886629db72 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:46.094190 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-8cb7dd74-9806-487e-948b-dcff53bf3cb1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:46.095448 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-8cb7dd74-9806-487e-948b-dcff53bf3cb1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.217041 Aug 09 18:16:46.096102 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 105/199] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:45 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:46.099800 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e96b9bbd-3ce1-4644-8b17-42886629db72 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:46.100276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e96b9bbd-3ce1-4644-8b17-42886629db72 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:46.100702 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e96b9bbd-3ce1-4644-8b17-42886629db72 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:46.101375 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e96b9bbd-3ce1-4644-8b17-42886629db72 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:46.101821 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e96b9bbd-3ce1-4644-8b17-42886629db72 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:46.102235 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e96b9bbd-3ce1-4644-8b17-42886629db72 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:46.229666 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e96b9bbd-3ce1-4644-8b17-42886629db72 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:46.237610 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e96b9bbd-3ce1-4644-8b17-42886629db72 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.148225 Aug 09 18:16:46.238173 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 95/200] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:46 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:47.109599 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-fb5bbc23-d4dc-4d6e-9e20-b8eaca4275b1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:47.110458 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-fb5bbc23-d4dc-4d6e-9e20-b8eaca4275b1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:47.116716 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fb5bbc23-d4dc-4d6e-9e20-b8eaca4275b1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:47.117205 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fb5bbc23-d4dc-4d6e-9e20-b8eaca4275b1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:47.117638 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e43eab57-09a7-46d2-929c-3a654e5a45e8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:47.118120 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fb5bbc23-d4dc-4d6e-9e20-b8eaca4275b1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:47.118247 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e43eab57-09a7-46d2-929c-3a654e5a45e8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:47.118368 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fb5bbc23-d4dc-4d6e-9e20-b8eaca4275b1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:47.118793 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fb5bbc23-d4dc-4d6e-9e20-b8eaca4275b1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:47.119215 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fb5bbc23-d4dc-4d6e-9e20-b8eaca4275b1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:47.125303 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e43eab57-09a7-46d2-929c-3a654e5a45e8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:47.125777 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e43eab57-09a7-46d2-929c-3a654e5a45e8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:47.126200 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e43eab57-09a7-46d2-929c-3a654e5a45e8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:47.126915 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e43eab57-09a7-46d2-929c-3a654e5a45e8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:47.127361 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e43eab57-09a7-46d2-929c-3a654e5a45e8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:47.127773 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e43eab57-09a7-46d2-929c-3a654e5a45e8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:47.312464 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-fb5bbc23-d4dc-4d6e-9e20-b8eaca4275b1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:47.315906 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e43eab57-09a7-46d2-929c-3a654e5a45e8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:47.320370 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-fb5bbc23-d4dc-4d6e-9e20-b8eaca4275b1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.214621 Aug 09 18:16:47.320939 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 106/201] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:47 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:47.326569 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c1f38ec5-5f75-413c-b74c-58c5d1b4c98d tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:47.326929 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e43eab57-09a7-46d2-929c-3a654e5a45e8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:47.327600 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-c1f38ec5-5f75-413c-b74c-58c5d1b4c98d tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:47.328606 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e43eab57-09a7-46d2-929c-3a654e5a45e8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:47.330554 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e43eab57-09a7-46d2-929c-3a654e5a45e8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.216251 Aug 09 18:16:47.338631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c1f38ec5-5f75-413c-b74c-58c5d1b4c98d tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:47.338631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c1f38ec5-5f75-413c-b74c-58c5d1b4c98d tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:47.338631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c1f38ec5-5f75-413c-b74c-58c5d1b4c98d tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:47.338631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c1f38ec5-5f75-413c-b74c-58c5d1b4c98d tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:47.339511 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c1f38ec5-5f75-413c-b74c-58c5d1b4c98d tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:47.339511 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c1f38ec5-5f75-413c-b74c-58c5d1b4c98d tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:47.340392 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 96/202] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:47 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:47.467699 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-c1f38ec5-5f75-413c-b74c-58c5d1b4c98d tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:47.475180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-c1f38ec5-5f75-413c-b74c-58c5d1b4c98d tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.153091 Aug 09 18:16:47.475802 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 107/203] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:47 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:48.341240 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-63b346f5-19f0-403f-8ff5-6e91135b2fbe tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:48.341767 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-63b346f5-19f0-403f-8ff5-6e91135b2fbe tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:48.347806 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-63b346f5-19f0-403f-8ff5-6e91135b2fbe tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:48.348294 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-63b346f5-19f0-403f-8ff5-6e91135b2fbe tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:48.348725 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-63b346f5-19f0-403f-8ff5-6e91135b2fbe tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:48.349407 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-63b346f5-19f0-403f-8ff5-6e91135b2fbe tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:48.349861 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-63b346f5-19f0-403f-8ff5-6e91135b2fbe tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:48.350282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-63b346f5-19f0-403f-8ff5-6e91135b2fbe tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:48.353492 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-0aefd9b0-d64f-44b5-ad1e-92eef400af3b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:48.356114 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-0aefd9b0-d64f-44b5-ad1e-92eef400af3b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:48.361738 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0aefd9b0-d64f-44b5-ad1e-92eef400af3b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:48.362353 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0aefd9b0-d64f-44b5-ad1e-92eef400af3b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:48.362896 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0aefd9b0-d64f-44b5-ad1e-92eef400af3b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:48.368444 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0aefd9b0-d64f-44b5-ad1e-92eef400af3b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:48.368444 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0aefd9b0-d64f-44b5-ad1e-92eef400af3b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:48.368444 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0aefd9b0-d64f-44b5-ad1e-92eef400af3b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:48.547722 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-63b346f5-19f0-403f-8ff5-6e91135b2fbe tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:48.555135 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-63b346f5-19f0-403f-8ff5-6e91135b2fbe tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.217869 Aug 09 18:16:48.555700 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 97/204] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:48 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:48.561266 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8c50a2f2-030f-4beb-818c-94ea377b9820 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:48.565542 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-0aefd9b0-d64f-44b5-ad1e-92eef400af3b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:48.569589 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8c50a2f2-030f-4beb-818c-94ea377b9820 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:48.573439 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-0aefd9b0-d64f-44b5-ad1e-92eef400af3b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:48.590972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-0aefd9b0-d64f-44b5-ad1e-92eef400af3b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:48.591313 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c50a2f2-030f-4beb-818c-94ea377b9820 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:48.592015 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-0aefd9b0-d64f-44b5-ad1e-92eef400af3b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.226697 Aug 09 18:16:48.592178 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c50a2f2-030f-4beb-818c-94ea377b9820 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:48.592276 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 108/205] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:48 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:16:48.592364 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c50a2f2-030f-4beb-818c-94ea377b9820 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:48.592364 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c50a2f2-030f-4beb-818c-94ea377b9820 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:48.592364 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c50a2f2-030f-4beb-818c-94ea377b9820 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:48.592364 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c50a2f2-030f-4beb-818c-94ea377b9820 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:48.708061 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8c50a2f2-030f-4beb-818c-94ea377b9820 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:48.716021 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8c50a2f2-030f-4beb-818c-94ea377b9820 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.159370 Aug 09 18:16:48.716584 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 98/206] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:48 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:49.586652 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-1cbd9c71-db71-44de-97da-41799f3ca1b3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:49.586652 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-1cbd9c71-db71-44de-97da-41799f3ca1b3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:49.586652 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1cbd9c71-db71-44de-97da-41799f3ca1b3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:49.586652 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1cbd9c71-db71-44de-97da-41799f3ca1b3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:49.587458 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1cbd9c71-db71-44de-97da-41799f3ca1b3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:49.587458 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1cbd9c71-db71-44de-97da-41799f3ca1b3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:49.587458 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1cbd9c71-db71-44de-97da-41799f3ca1b3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:49.587458 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1cbd9c71-db71-44de-97da-41799f3ca1b3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:49.607154 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e90a2385-5d03-406b-829a-94a98117d5d1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:49.608575 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e90a2385-5d03-406b-829a-94a98117d5d1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:49.615008 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e90a2385-5d03-406b-829a-94a98117d5d1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:49.615562 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e90a2385-5d03-406b-829a-94a98117d5d1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:49.616999 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e90a2385-5d03-406b-829a-94a98117d5d1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:49.617799 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e90a2385-5d03-406b-829a-94a98117d5d1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:49.618325 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e90a2385-5d03-406b-829a-94a98117d5d1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:49.618864 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e90a2385-5d03-406b-829a-94a98117d5d1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:50.011601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e90a2385-5d03-406b-829a-94a98117d5d1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:50.020070 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e90a2385-5d03-406b-829a-94a98117d5d1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:50.021719 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e90a2385-5d03-406b-829a-94a98117d5d1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:50.023150 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e90a2385-5d03-406b-829a-94a98117d5d1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.423109 Aug 09 18:16:50.023743 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 99/207] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:49 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:50.026000 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-1cbd9c71-db71-44de-97da-41799f3ca1b3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:50.029265 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c9043d2f-d974-4677-b18a-3a2e1fb7c345 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:50.030049 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c9043d2f-d974-4677-b18a-3a2e1fb7c345 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:50.035119 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-1cbd9c71-db71-44de-97da-41799f3ca1b3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.461749 Aug 09 18:16:50.036312 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 109/208] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:49 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:50.046125 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-0e96a198-c873-4d34-a4ec-3d6c9407e024 req-80ef8cda-4934-492e-90ac-8ab0bc31ee6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97", "name": "network-vif-plugged", "status": "completed", "tag": "be3a4bfe-af09-41a6-9567-0b2aabb83ff4"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:16:50.046277 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c9043d2f-d974-4677-b18a-3a2e1fb7c345 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:50.046277 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c9043d2f-d974-4677-b18a-3a2e1fb7c345 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:50.046277 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c9043d2f-d974-4677-b18a-3a2e1fb7c345 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:50.046277 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c9043d2f-d974-4677-b18a-3a2e1fb7c345 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:50.046560 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c9043d2f-d974-4677-b18a-3a2e1fb7c345 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:50.046560 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c9043d2f-d974-4677-b18a-3a2e1fb7c345 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:50.051681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-0e96a198-c873-4d34-a4ec-3d6c9407e024 req-80ef8cda-4934-492e-90ac-8ab0bc31ee6b service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:50.052155 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-0e96a198-c873-4d34-a4ec-3d6c9407e024 req-80ef8cda-4934-492e-90ac-8ab0bc31ee6b service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:50.055102 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-0e96a198-c873-4d34-a4ec-3d6c9407e024 req-80ef8cda-4934-492e-90ac-8ab0bc31ee6b service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:50.070517 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-0e96a198-c873-4d34-a4ec-3d6c9407e024 req-80ef8cda-4934-492e-90ac-8ab0bc31ee6b service nova] Creating event network-vif-plugged:be3a4bfe-af09-41a6-9567-0b2aabb83ff4 for instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 on hv-cinder-79797 Aug 09 18:16:50.080712 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-0e96a198-c873-4d34-a4ec-3d6c9407e024 req-80ef8cda-4934-492e-90ac-8ab0bc31ee6b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042784 Aug 09 18:16:50.082088 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 110/209] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:16:50.183118 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c9043d2f-d974-4677-b18a-3a2e1fb7c345 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:50.190402 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c9043d2f-d974-4677-b18a-3a2e1fb7c345 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1314 microversion: 2.1 time: 0.165638 Aug 09 18:16:50.191025 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 100/210] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:50 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:51.048124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-4a50948f-eb31-4505-a833-0ec74b3671fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:51.048873 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-4a50948f-eb31-4505-a833-0ec74b3671fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:51.057590 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4a50948f-eb31-4505-a833-0ec74b3671fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:51.058070 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4a50948f-eb31-4505-a833-0ec74b3671fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:51.058467 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4a50948f-eb31-4505-a833-0ec74b3671fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:51.059274 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4a50948f-eb31-4505-a833-0ec74b3671fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:51.059966 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4a50948f-eb31-4505-a833-0ec74b3671fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:51.060541 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4a50948f-eb31-4505-a833-0ec74b3671fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:51.062073 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-45ea916c-d5ef-448a-9ee1-0a10419946e3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:51.063260 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-45ea916c-d5ef-448a-9ee1-0a10419946e3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:51.071075 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-45ea916c-d5ef-448a-9ee1-0a10419946e3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:51.071640 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-45ea916c-d5ef-448a-9ee1-0a10419946e3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:51.072698 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-45ea916c-d5ef-448a-9ee1-0a10419946e3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:51.073645 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-45ea916c-d5ef-448a-9ee1-0a10419946e3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:51.075607 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-45ea916c-d5ef-448a-9ee1-0a10419946e3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:51.076051 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-45ea916c-d5ef-448a-9ee1-0a10419946e3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:51.429975 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4a50948f-eb31-4505-a833-0ec74b3671fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:51.438043 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4a50948f-eb31-4505-a833-0ec74b3671fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:51.439623 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4a50948f-eb31-4505-a833-0ec74b3671fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:51.440761 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-4a50948f-eb31-4505-a833-0ec74b3671fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.397068 Aug 09 18:16:51.441327 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 111/211] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:51 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:51.444772 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-45ea916c-d5ef-448a-9ee1-0a10419946e3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:51.446415 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-95e4b41e-d3e4-4f93-8dc0-a1a4be9946ac tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:51.447204 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-95e4b41e-d3e4-4f93-8dc0-a1a4be9946ac tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:51.467050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-95e4b41e-d3e4-4f93-8dc0-a1a4be9946ac tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:51.467898 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-95e4b41e-d3e4-4f93-8dc0-a1a4be9946ac tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:51.469128 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-95e4b41e-d3e4-4f93-8dc0-a1a4be9946ac tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:51.470093 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-95e4b41e-d3e4-4f93-8dc0-a1a4be9946ac tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:51.470840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-95e4b41e-d3e4-4f93-8dc0-a1a4be9946ac tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:51.471426 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-95e4b41e-d3e4-4f93-8dc0-a1a4be9946ac tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:51.477305 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-45ea916c-d5ef-448a-9ee1-0a10419946e3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.424721 Aug 09 18:16:51.486774 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 101/212] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:51 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:51.650102 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-95e4b41e-d3e4-4f93-8dc0-a1a4be9946ac tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:51.655547 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-95e4b41e-d3e4-4f93-8dc0-a1a4be9946ac tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1500 microversion: 2.1 time: 0.213201 Aug 09 18:16:51.659175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 112/213] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:51 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1500 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:52.471404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-40fe56cc-40ab-4056-b22e-26b17b354494 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:52.473257 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-40fe56cc-40ab-4056-b22e-26b17b354494 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:52.482855 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-40fe56cc-40ab-4056-b22e-26b17b354494 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:52.482855 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-40fe56cc-40ab-4056-b22e-26b17b354494 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:52.482855 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-40fe56cc-40ab-4056-b22e-26b17b354494 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:52.482855 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-40fe56cc-40ab-4056-b22e-26b17b354494 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:52.483201 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-40fe56cc-40ab-4056-b22e-26b17b354494 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:52.483201 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-40fe56cc-40ab-4056-b22e-26b17b354494 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:52.512081 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2b204f38-8d40-4c4d-ab4e-d31a8f66e8f2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:52.512081 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-2b204f38-8d40-4c4d-ab4e-d31a8f66e8f2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:52.516888 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2b204f38-8d40-4c4d-ab4e-d31a8f66e8f2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:52.517800 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2b204f38-8d40-4c4d-ab4e-d31a8f66e8f2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:52.518454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2b204f38-8d40-4c4d-ab4e-d31a8f66e8f2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:52.519453 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2b204f38-8d40-4c4d-ab4e-d31a8f66e8f2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:52.520507 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2b204f38-8d40-4c4d-ab4e-d31a8f66e8f2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:52.521085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2b204f38-8d40-4c4d-ab4e-d31a8f66e8f2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:52.763471 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-40fe56cc-40ab-4056-b22e-26b17b354494 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:52.771884 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-40fe56cc-40ab-4056-b22e-26b17b354494 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:52.773391 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-40fe56cc-40ab-4056-b22e-26b17b354494 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:52.774515 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-40fe56cc-40ab-4056-b22e-26b17b354494 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.312808 Aug 09 18:16:52.775095 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 102/214] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:52 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:16:52.797874 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-2b204f38-8d40-4c4d-ab4e-d31a8f66e8f2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:52.805766 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-2b204f38-8d40-4c4d-ab4e-d31a8f66e8f2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1321 microversion: 2.1 time: 0.303137 Aug 09 18:16:52.806329 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 113/215] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:52 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:53.799410 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-bdcd4be7-7fe4-4705-83d3-e388ce9533c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:53.799410 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-bdcd4be7-7fe4-4705-83d3-e388ce9533c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:53.804698 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bdcd4be7-7fe4-4705-83d3-e388ce9533c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:53.805178 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bdcd4be7-7fe4-4705-83d3-e388ce9533c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:53.805753 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bdcd4be7-7fe4-4705-83d3-e388ce9533c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:53.806444 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bdcd4be7-7fe4-4705-83d3-e388ce9533c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:53.806930 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bdcd4be7-7fe4-4705-83d3-e388ce9533c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:53.807349 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bdcd4be7-7fe4-4705-83d3-e388ce9533c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:53.828610 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f6d01413-3a9b-4da1-952f-670a27725d7f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:53.829549 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f6d01413-3a9b-4da1-952f-670a27725d7f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:53.835771 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f6d01413-3a9b-4da1-952f-670a27725d7f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:53.836314 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f6d01413-3a9b-4da1-952f-670a27725d7f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:53.836956 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f6d01413-3a9b-4da1-952f-670a27725d7f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:53.837784 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f6d01413-3a9b-4da1-952f-670a27725d7f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:53.838301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f6d01413-3a9b-4da1-952f-670a27725d7f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:53.838806 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f6d01413-3a9b-4da1-952f-670a27725d7f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:53.859030 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=100 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:16:54.019400 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-bdcd4be7-7fe4-4705-83d3-e388ce9533c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:54.023698 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f6d01413-3a9b-4da1-952f-670a27725d7f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:54.027600 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-bdcd4be7-7fe4-4705-83d3-e388ce9533c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:54.029330 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-bdcd4be7-7fe4-4705-83d3-e388ce9533c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:54.030439 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-bdcd4be7-7fe4-4705-83d3-e388ce9533c1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.237821 Aug 09 18:16:54.031168 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 103/216] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:53 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:16:54.031451 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f6d01413-3a9b-4da1-952f-670a27725d7f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1515 microversion: 2.1 time: 0.207716 Aug 09 18:16:54.032007 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 114/217] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:53 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1515 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:54.053528 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-0f201c9e-9318-4eac-947f-4997c121aa16 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:16:54.055289 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-0f201c9e-9318-4eac-947f-4997c121aa16 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:54.063229 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0f201c9e-9318-4eac-947f-4997c121aa16 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:54.063708 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0f201c9e-9318-4eac-947f-4997c121aa16 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:54.064134 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0f201c9e-9318-4eac-947f-4997c121aa16 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:54.064823 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0f201c9e-9318-4eac-947f-4997c121aa16 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:54.065287 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0f201c9e-9318-4eac-947f-4997c121aa16 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:54.065739 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0f201c9e-9318-4eac-947f-4997c121aa16 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:54.131055 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.objects.instance [None req-0f201c9e-9318-4eac-947f-4997c121aa16 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lazy-loading 'flavor' on Instance uuid 67d6f4e3-a426-423e-960e-05c7bac110c9 {{(pid=118314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:16:54.475245 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-0f201c9e-9318-4eac-947f-4997c121aa16 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "POST /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9/action" status: 200 len: 32 microversion: 2.1 time: 0.426428 Aug 09 18:16:54.475855 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 104/218] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Aug 9 18:16:54 2022] POST /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9/action => generated 32 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 18:16:54.488348 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-4db50b74-a784-4934-bd47-e7120534656f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:54.488947 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-4db50b74-a784-4934-bd47-e7120534656f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:54.494872 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4db50b74-a784-4934-bd47-e7120534656f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:54.495353 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4db50b74-a784-4934-bd47-e7120534656f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:54.495774 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4db50b74-a784-4934-bd47-e7120534656f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:54.496493 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4db50b74-a784-4934-bd47-e7120534656f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:54.498114 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4db50b74-a784-4934-bd47-e7120534656f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:54.498544 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4db50b74-a784-4934-bd47-e7120534656f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:54.661912 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4db50b74-a784-4934-bd47-e7120534656f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:54.670042 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-4db50b74-a784-4934-bd47-e7120534656f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.186151 Aug 09 18:16:54.670698 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 115/219] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:54 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:54.700734 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d3737516-ef7f-4e92-b051-e2a696f10a57 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "738f5a3e-f206-493c-8d22-ec5be4c2c646"}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:16:54.703190 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d3737516-ef7f-4e92-b051-e2a696f10a57 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:54.709175 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d3737516-ef7f-4e92-b051-e2a696f10a57 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:54.709654 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d3737516-ef7f-4e92-b051-e2a696f10a57 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:54.710101 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d3737516-ef7f-4e92-b051-e2a696f10a57 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:54.710825 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d3737516-ef7f-4e92-b051-e2a696f10a57 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:54.715233 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d3737516-ef7f-4e92-b051-e2a696f10a57 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:54.715233 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d3737516-ef7f-4e92-b051-e2a696f10a57 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:54.715233 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:16:55.053394 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9a2b9901-7356-492f-b822-ee53387cd0f7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:55.054008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9a2b9901-7356-492f-b822-ee53387cd0f7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:55.060568 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9a2b9901-7356-492f-b822-ee53387cd0f7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:55.061032 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9a2b9901-7356-492f-b822-ee53387cd0f7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:55.061524 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9a2b9901-7356-492f-b822-ee53387cd0f7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:55.062129 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9a2b9901-7356-492f-b822-ee53387cd0f7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:55.062577 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9a2b9901-7356-492f-b822-ee53387cd0f7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:55.063019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9a2b9901-7356-492f-b822-ee53387cd0f7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:55.192043 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9a2b9901-7356-492f-b822-ee53387cd0f7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:55.200491 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9a2b9901-7356-492f-b822-ee53387cd0f7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:55.202041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9a2b9901-7356-492f-b822-ee53387cd0f7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:55.203172 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9a2b9901-7356-492f-b822-ee53387cd0f7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1408 microversion: 2.20 time: 0.153774 Aug 09 18:16:55.203727 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 116/220] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:55 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:55.692769 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d819a7a5-f8a2-4b4a-a53e-7afdce1c4496 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:55.693595 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d819a7a5-f8a2-4b4a-a53e-7afdce1c4496 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:55.702639 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d819a7a5-f8a2-4b4a-a53e-7afdce1c4496 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:55.703254 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d819a7a5-f8a2-4b4a-a53e-7afdce1c4496 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:55.704443 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d819a7a5-f8a2-4b4a-a53e-7afdce1c4496 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:55.706067 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d819a7a5-f8a2-4b4a-a53e-7afdce1c4496 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:55.706730 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d819a7a5-f8a2-4b4a-a53e-7afdce1c4496 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:55.707424 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d819a7a5-f8a2-4b4a-a53e-7afdce1c4496 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:55.958052 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d819a7a5-f8a2-4b4a-a53e-7afdce1c4496 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:55.965767 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d819a7a5-f8a2-4b4a-a53e-7afdce1c4496 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.277384 Aug 09 18:16:55.966853 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 117/221] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:55 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:56.225888 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-93085c4b-da05-4f43-b841-c10525cce55e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:56.226514 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-93085c4b-da05-4f43-b841-c10525cce55e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:56.233292 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-93085c4b-da05-4f43-b841-c10525cce55e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:56.237577 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-93085c4b-da05-4f43-b841-c10525cce55e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:56.237577 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-93085c4b-da05-4f43-b841-c10525cce55e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:56.237577 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-93085c4b-da05-4f43-b841-c10525cce55e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:56.237577 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-93085c4b-da05-4f43-b841-c10525cce55e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:56.237910 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-93085c4b-da05-4f43-b841-c10525cce55e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:56.363424 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-93085c4b-da05-4f43-b841-c10525cce55e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:56.371944 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-93085c4b-da05-4f43-b841-c10525cce55e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:56.372751 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d3737516-ef7f-4e92-b051-e2a696f10a57 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "POST /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.676108 Aug 09 18:16:56.373632 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 105/222] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Aug 9 18:16:54 2022] POST /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b/os-volume_attachments => generated 194 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:16:56.378786 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-93085c4b-da05-4f43-b841-c10525cce55e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:56.379988 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-93085c4b-da05-4f43-b841-c10525cce55e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1601 microversion: 2.20 time: 0.158033 Aug 09 18:16:56.380549 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 118/223] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:16:56 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:16:56.403841 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-486d9df6-6b11-4d05-9226-276cfcc185a4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:56.404696 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-486d9df6-6b11-4d05-9226-276cfcc185a4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:56.410888 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-486d9df6-6b11-4d05-9226-276cfcc185a4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:56.411363 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-486d9df6-6b11-4d05-9226-276cfcc185a4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:56.411799 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-486d9df6-6b11-4d05-9226-276cfcc185a4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:56.412467 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-486d9df6-6b11-4d05-9226-276cfcc185a4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:56.412911 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-486d9df6-6b11-4d05-9226-276cfcc185a4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:56.413329 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-486d9df6-6b11-4d05-9226-276cfcc185a4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:56.500297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-486d9df6-6b11-4d05-9226-276cfcc185a4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.101337 Aug 09 18:16:56.500986 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 106/224] 10.222.0.36 () {60 vars in 1316 bytes} [Tue Aug 9 18:16:56 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:16:56.989170 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-8dc7ab2b-fcc9-4603-92eb-3de5a217e11f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:56.990099 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-8dc7ab2b-fcc9-4603-92eb-3de5a217e11f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:56.998963 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8dc7ab2b-fcc9-4603-92eb-3de5a217e11f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:57.000030 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8dc7ab2b-fcc9-4603-92eb-3de5a217e11f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:57.000860 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8dc7ab2b-fcc9-4603-92eb-3de5a217e11f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:57.002030 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8dc7ab2b-fcc9-4603-92eb-3de5a217e11f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:57.002647 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8dc7ab2b-fcc9-4603-92eb-3de5a217e11f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:57.003520 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8dc7ab2b-fcc9-4603-92eb-3de5a217e11f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:57.392457 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-8dc7ab2b-fcc9-4603-92eb-3de5a217e11f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:57.399952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-8dc7ab2b-fcc9-4603-92eb-3de5a217e11f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.415713 Aug 09 18:16:57.400723 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 119/225] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:56 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:58.036713 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-728167f4-98f4-4567-bef2-fd6f2d79f7de req-ed8c0332-2b30-480c-85a3-c84ad4dbf274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97", "tag": "be3a4bfe-af09-41a6-9567-0b2aabb83ff4"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:16:58.049722 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-728167f4-98f4-4567-bef2-fd6f2d79f7de req-ed8c0332-2b30-480c-85a3-c84ad4dbf274 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:58.050200 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-728167f4-98f4-4567-bef2-fd6f2d79f7de req-ed8c0332-2b30-480c-85a3-c84ad4dbf274 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:58.050629 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-728167f4-98f4-4567-bef2-fd6f2d79f7de req-ed8c0332-2b30-480c-85a3-c84ad4dbf274 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:58.081488 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-728167f4-98f4-4567-bef2-fd6f2d79f7de req-ed8c0332-2b30-480c-85a3-c84ad4dbf274 service nova] Creating event network-changed:be3a4bfe-af09-41a6-9567-0b2aabb83ff4 for instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 on hv-cinder-79797 Aug 09 18:16:58.103638 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-728167f4-98f4-4567-bef2-fd6f2d79f7de req-ed8c0332-2b30-480c-85a3-c84ad4dbf274 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069227 Aug 09 18:16:58.115906 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 107/226] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:16:58.422416 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-1c648ecf-cc61-444d-bf42-5011b3b903b9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:58.423314 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-1c648ecf-cc61-444d-bf42-5011b3b903b9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:58.429297 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1c648ecf-cc61-444d-bf42-5011b3b903b9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:58.429788 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1c648ecf-cc61-444d-bf42-5011b3b903b9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:58.430225 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1c648ecf-cc61-444d-bf42-5011b3b903b9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:58.433811 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1c648ecf-cc61-444d-bf42-5011b3b903b9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:58.433811 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1c648ecf-cc61-444d-bf42-5011b3b903b9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:58.433811 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1c648ecf-cc61-444d-bf42-5011b3b903b9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:58.573665 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-1c648ecf-cc61-444d-bf42-5011b3b903b9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:58.581813 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-1c648ecf-cc61-444d-bf42-5011b3b903b9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.164820 Aug 09 18:16:58.582403 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 120/227] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:58 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:59.608562 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f8f953cc-1deb-497c-9cea-d95e1e99f5e7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:59.609350 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f8f953cc-1deb-497c-9cea-d95e1e99f5e7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:59.616237 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f8f953cc-1deb-497c-9cea-d95e1e99f5e7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:59.617056 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f8f953cc-1deb-497c-9cea-d95e1e99f5e7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:59.617527 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f8f953cc-1deb-497c-9cea-d95e1e99f5e7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:59.618577 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f8f953cc-1deb-497c-9cea-d95e1e99f5e7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:59.619181 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f8f953cc-1deb-497c-9cea-d95e1e99f5e7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:59.619617 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f8f953cc-1deb-497c-9cea-d95e1e99f5e7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:59.749836 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f8f953cc-1deb-497c-9cea-d95e1e99f5e7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:59.759170 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f8f953cc-1deb-497c-9cea-d95e1e99f5e7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.156994 Aug 09 18:16:59.763666 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 108/228] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:59 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:00.784737 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-3d9afd9b-fd4a-4336-bc41-fc48492f8159 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:00.785365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-3d9afd9b-fd4a-4336-bc41-fc48492f8159 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:00.791254 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3d9afd9b-fd4a-4336-bc41-fc48492f8159 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:00.791823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3d9afd9b-fd4a-4336-bc41-fc48492f8159 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:00.792257 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3d9afd9b-fd4a-4336-bc41-fc48492f8159 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:00.792935 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3d9afd9b-fd4a-4336-bc41-fc48492f8159 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:00.794004 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3d9afd9b-fd4a-4336-bc41-fc48492f8159 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:00.794788 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3d9afd9b-fd4a-4336-bc41-fc48492f8159 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:01.178034 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-3d9afd9b-fd4a-4336-bc41-fc48492f8159 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:01.186691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-3d9afd9b-fd4a-4336-bc41-fc48492f8159 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.405698 Aug 09 18:17:01.187283 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 121/229] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:00 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:02.208322 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-25119599-3707-43e2-8fb2-7d74973f9795 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:02.209211 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-25119599-3707-43e2-8fb2-7d74973f9795 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:02.216668 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-25119599-3707-43e2-8fb2-7d74973f9795 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:02.217161 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-25119599-3707-43e2-8fb2-7d74973f9795 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:02.217596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-25119599-3707-43e2-8fb2-7d74973f9795 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:02.218277 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-25119599-3707-43e2-8fb2-7d74973f9795 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:02.218741 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-25119599-3707-43e2-8fb2-7d74973f9795 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:02.219163 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-25119599-3707-43e2-8fb2-7d74973f9795 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:02.367183 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-25119599-3707-43e2-8fb2-7d74973f9795 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:02.375849 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-25119599-3707-43e2-8fb2-7d74973f9795 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.171279 Aug 09 18:17:02.376417 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 109/230] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:02 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:03.397069 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c189abcc-2c1a-4486-91d3-ddaadecd56cf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:03.397673 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-c189abcc-2c1a-4486-91d3-ddaadecd56cf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:03.399624 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=66 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:17:03.404710 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c189abcc-2c1a-4486-91d3-ddaadecd56cf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:03.405309 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c189abcc-2c1a-4486-91d3-ddaadecd56cf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:03.405737 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c189abcc-2c1a-4486-91d3-ddaadecd56cf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:03.406515 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c189abcc-2c1a-4486-91d3-ddaadecd56cf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:03.406990 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c189abcc-2c1a-4486-91d3-ddaadecd56cf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:03.407409 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c189abcc-2c1a-4486-91d3-ddaadecd56cf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:03.580805 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-c189abcc-2c1a-4486-91d3-ddaadecd56cf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:03.590927 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-c189abcc-2c1a-4486-91d3-ddaadecd56cf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.195330 Aug 09 18:17:03.590927 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 122/231] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:03 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:04.613001 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-7d16e758-f7bb-4743-9e16-736b677fbac7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:04.614447 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-7d16e758-f7bb-4743-9e16-736b677fbac7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:04.626860 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=62 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:17:04.629079 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7d16e758-f7bb-4743-9e16-736b677fbac7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:04.629571 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7d16e758-f7bb-4743-9e16-736b677fbac7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:04.630082 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7d16e758-f7bb-4743-9e16-736b677fbac7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:04.630814 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7d16e758-f7bb-4743-9e16-736b677fbac7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:04.631263 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7d16e758-f7bb-4743-9e16-736b677fbac7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:04.631675 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7d16e758-f7bb-4743-9e16-736b677fbac7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:04.980136 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-7d16e758-f7bb-4743-9e16-736b677fbac7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:04.980136 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-7d16e758-f7bb-4743-9e16-736b677fbac7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.358418 Aug 09 18:17:04.980136 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 110/232] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:04 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:05.995729 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-fd1f92ec-b661-40fa-a97f-798c7898a385 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:05.998787 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-fd1f92ec-b661-40fa-a97f-798c7898a385 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:06.005078 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fd1f92ec-b661-40fa-a97f-798c7898a385 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:06.005559 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fd1f92ec-b661-40fa-a97f-798c7898a385 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:06.005989 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fd1f92ec-b661-40fa-a97f-798c7898a385 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:06.006692 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fd1f92ec-b661-40fa-a97f-798c7898a385 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:06.007207 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fd1f92ec-b661-40fa-a97f-798c7898a385 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:06.007808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fd1f92ec-b661-40fa-a97f-798c7898a385 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:06.151490 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-fd1f92ec-b661-40fa-a97f-798c7898a385 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:06.159679 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-fd1f92ec-b661-40fa-a97f-798c7898a385 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.168759 Aug 09 18:17:06.160758 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 123/233] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:05 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:07.181289 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-64759954-caf0-4d97-87b7-c2f933df51aa tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:07.181900 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-64759954-caf0-4d97-87b7-c2f933df51aa tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:07.188622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-64759954-caf0-4d97-87b7-c2f933df51aa tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:07.189103 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-64759954-caf0-4d97-87b7-c2f933df51aa tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:07.189541 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-64759954-caf0-4d97-87b7-c2f933df51aa tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:07.190228 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-64759954-caf0-4d97-87b7-c2f933df51aa tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:07.190678 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-64759954-caf0-4d97-87b7-c2f933df51aa tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:07.191173 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-64759954-caf0-4d97-87b7-c2f933df51aa tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:07.408161 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-64759954-caf0-4d97-87b7-c2f933df51aa tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:07.419154 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-64759954-caf0-4d97-87b7-c2f933df51aa tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.241167 Aug 09 18:17:07.419747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 111/234] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:07 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:08.439785 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-81eb5824-eed0-4ca2-9293-9518186e2e40 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:08.440293 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-81eb5824-eed0-4ca2-9293-9518186e2e40 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:08.446032 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-81eb5824-eed0-4ca2-9293-9518186e2e40 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:08.446522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-81eb5824-eed0-4ca2-9293-9518186e2e40 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:08.446992 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-81eb5824-eed0-4ca2-9293-9518186e2e40 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:08.447692 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-81eb5824-eed0-4ca2-9293-9518186e2e40 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:08.448147 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-81eb5824-eed0-4ca2-9293-9518186e2e40 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:08.448574 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-81eb5824-eed0-4ca2-9293-9518186e2e40 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:08.595089 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-81eb5824-eed0-4ca2-9293-9518186e2e40 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:08.602642 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-81eb5824-eed0-4ca2-9293-9518186e2e40 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.166914 Aug 09 18:17:08.603232 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 124/235] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:08 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:09.625320 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-5c5396ff-7cf7-4c36-afa7-ff03b45ecf48 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:09.625937 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-5c5396ff-7cf7-4c36-afa7-ff03b45ecf48 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:09.632591 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5c5396ff-7cf7-4c36-afa7-ff03b45ecf48 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:09.633081 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5c5396ff-7cf7-4c36-afa7-ff03b45ecf48 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:09.633521 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5c5396ff-7cf7-4c36-afa7-ff03b45ecf48 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:09.634231 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5c5396ff-7cf7-4c36-afa7-ff03b45ecf48 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:09.634725 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5c5396ff-7cf7-4c36-afa7-ff03b45ecf48 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:09.635162 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5c5396ff-7cf7-4c36-afa7-ff03b45ecf48 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:09.766004 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-5c5396ff-7cf7-4c36-afa7-ff03b45ecf48 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:09.773845 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-5c5396ff-7cf7-4c36-afa7-ff03b45ecf48 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.153558 Aug 09 18:17:09.774415 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 112/236] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:09 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:10.795065 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-0348eb95-1537-4d48-bdaa-979d5543fd8f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:10.795690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-0348eb95-1537-4d48-bdaa-979d5543fd8f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:10.801757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0348eb95-1537-4d48-bdaa-979d5543fd8f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:10.802247 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0348eb95-1537-4d48-bdaa-979d5543fd8f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:10.802719 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0348eb95-1537-4d48-bdaa-979d5543fd8f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:10.803397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0348eb95-1537-4d48-bdaa-979d5543fd8f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:10.803870 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0348eb95-1537-4d48-bdaa-979d5543fd8f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:10.804296 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0348eb95-1537-4d48-bdaa-979d5543fd8f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:10.939592 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-0348eb95-1537-4d48-bdaa-979d5543fd8f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:10.947714 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-0348eb95-1537-4d48-bdaa-979d5543fd8f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.156776 Aug 09 18:17:10.948361 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 125/237] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:10 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:11.969927 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-9915b890-4d39-4d1b-aec8-6e1f1fb8f1ee tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:11.970538 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-9915b890-4d39-4d1b-aec8-6e1f1fb8f1ee tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:11.976911 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9915b890-4d39-4d1b-aec8-6e1f1fb8f1ee tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:11.977389 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9915b890-4d39-4d1b-aec8-6e1f1fb8f1ee tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:11.977822 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9915b890-4d39-4d1b-aec8-6e1f1fb8f1ee tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:11.978501 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9915b890-4d39-4d1b-aec8-6e1f1fb8f1ee tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:11.978992 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9915b890-4d39-4d1b-aec8-6e1f1fb8f1ee tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:11.979413 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9915b890-4d39-4d1b-aec8-6e1f1fb8f1ee tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:12.131960 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-9915b890-4d39-4d1b-aec8-6e1f1fb8f1ee tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:12.140117 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-9915b890-4d39-4d1b-aec8-6e1f1fb8f1ee tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.173991 Aug 09 18:17:12.141021 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 113/238] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:11 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:13.163550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-ea48ff46-d800-469e-9a77-1faa87fe8af4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:13.163550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-ea48ff46-d800-469e-9a77-1faa87fe8af4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:13.168735 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ea48ff46-d800-469e-9a77-1faa87fe8af4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:13.169282 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ea48ff46-d800-469e-9a77-1faa87fe8af4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:13.169875 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ea48ff46-d800-469e-9a77-1faa87fe8af4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:13.170279 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ea48ff46-d800-469e-9a77-1faa87fe8af4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:13.170548 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ea48ff46-d800-469e-9a77-1faa87fe8af4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:13.170998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ea48ff46-d800-469e-9a77-1faa87fe8af4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:13.317867 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ea48ff46-d800-469e-9a77-1faa87fe8af4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:13.326504 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-ea48ff46-d800-469e-9a77-1faa87fe8af4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.169038 Aug 09 18:17:13.327296 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 126/239] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:13 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:14.348831 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-16df9ba4-eb61-4ad5-b118-edda3a9f3062 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:14.349448 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-16df9ba4-eb61-4ad5-b118-edda3a9f3062 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:14.355797 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-16df9ba4-eb61-4ad5-b118-edda3a9f3062 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:14.356296 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-16df9ba4-eb61-4ad5-b118-edda3a9f3062 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:14.356737 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-16df9ba4-eb61-4ad5-b118-edda3a9f3062 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:14.357431 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-16df9ba4-eb61-4ad5-b118-edda3a9f3062 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:14.357887 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-16df9ba4-eb61-4ad5-b118-edda3a9f3062 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:14.358312 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-16df9ba4-eb61-4ad5-b118-edda3a9f3062 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:14.488985 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-16df9ba4-eb61-4ad5-b118-edda3a9f3062 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:14.496915 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-16df9ba4-eb61-4ad5-b118-edda3a9f3062 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.152555 Aug 09 18:17:14.497484 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 114/240] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:14 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:15.517927 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d7b0ce57-ce7d-4334-8870-5fe9202424c6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:15.518533 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d7b0ce57-ce7d-4334-8870-5fe9202424c6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:15.524435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d7b0ce57-ce7d-4334-8870-5fe9202424c6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:15.529637 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d7b0ce57-ce7d-4334-8870-5fe9202424c6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:15.529637 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d7b0ce57-ce7d-4334-8870-5fe9202424c6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:15.529637 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d7b0ce57-ce7d-4334-8870-5fe9202424c6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:15.529637 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d7b0ce57-ce7d-4334-8870-5fe9202424c6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:15.530110 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d7b0ce57-ce7d-4334-8870-5fe9202424c6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:15.679755 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d7b0ce57-ce7d-4334-8870-5fe9202424c6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:15.688882 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d7b0ce57-ce7d-4334-8870-5fe9202424c6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.174787 Aug 09 18:17:15.693531 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 127/241] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:15 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:16.710315 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c8ea652e-fc06-4ef7-8ebd-138df96e94f2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:16.710953 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c8ea652e-fc06-4ef7-8ebd-138df96e94f2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:16.717981 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c8ea652e-fc06-4ef7-8ebd-138df96e94f2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:16.718464 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c8ea652e-fc06-4ef7-8ebd-138df96e94f2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:16.718945 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c8ea652e-fc06-4ef7-8ebd-138df96e94f2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:16.719631 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c8ea652e-fc06-4ef7-8ebd-138df96e94f2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:16.720117 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c8ea652e-fc06-4ef7-8ebd-138df96e94f2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:16.720546 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c8ea652e-fc06-4ef7-8ebd-138df96e94f2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:16.863135 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c8ea652e-fc06-4ef7-8ebd-138df96e94f2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:16.869501 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c8ea652e-fc06-4ef7-8ebd-138df96e94f2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.163012 Aug 09 18:17:16.870342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 115/242] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:16 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:16.888931 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-db979d22-c689-4bf3-a6a6-4c1bc93f1b50 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:16.889652 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-db979d22-c689-4bf3-a6a6-4c1bc93f1b50 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:16.895786 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-db979d22-c689-4bf3-a6a6-4c1bc93f1b50 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:16.896274 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-db979d22-c689-4bf3-a6a6-4c1bc93f1b50 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:16.896733 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-db979d22-c689-4bf3-a6a6-4c1bc93f1b50 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:16.897416 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-db979d22-c689-4bf3-a6a6-4c1bc93f1b50 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:16.897872 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-db979d22-c689-4bf3-a6a6-4c1bc93f1b50 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:16.898294 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-db979d22-c689-4bf3-a6a6-4c1bc93f1b50 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:16.923956 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-db979d22-c689-4bf3-a6a6-4c1bc93f1b50 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Going to try to terminate instance {{(pid=118313) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:17:17.236724 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-db979d22-c689-4bf3-a6a6-4c1bc93f1b50 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 204 len: 0 microversion: 2.1 time: 0.352124 Aug 09 18:17:17.237306 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 128/243] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:17:16 2022] DELETE /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:17:17.245520 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-722965c6-243c-41b3-9e77-dfe919cbe07f tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:17.246146 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-722965c6-243c-41b3-9e77-dfe919cbe07f tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:17.252798 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-722965c6-243c-41b3-9e77-dfe919cbe07f tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:17.253282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-722965c6-243c-41b3-9e77-dfe919cbe07f tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:17.253723 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-722965c6-243c-41b3-9e77-dfe919cbe07f tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:17.254420 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-722965c6-243c-41b3-9e77-dfe919cbe07f tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:17.254894 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-722965c6-243c-41b3-9e77-dfe919cbe07f tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:17.255376 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-722965c6-243c-41b3-9e77-dfe919cbe07f tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:17.392276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-722965c6-243c-41b3-9e77-dfe919cbe07f tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:17.400463 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-722965c6-243c-41b3-9e77-dfe919cbe07f tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1552 microversion: 2.1 time: 0.158824 Aug 09 18:17:17.401035 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 116/244] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:17 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:17.891283 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-794e730f-785f-49ba-b730-34e68bae5e60 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:17.891972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-794e730f-785f-49ba-b730-34e68bae5e60 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:17.897882 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-794e730f-785f-49ba-b730-34e68bae5e60 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:17.898364 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-794e730f-785f-49ba-b730-34e68bae5e60 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:17.898831 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-794e730f-785f-49ba-b730-34e68bae5e60 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:17.899515 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-794e730f-785f-49ba-b730-34e68bae5e60 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:17.899967 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-794e730f-785f-49ba-b730-34e68bae5e60 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:17.900388 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-794e730f-785f-49ba-b730-34e68bae5e60 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:17.920007 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:17:18.032914 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-794e730f-785f-49ba-b730-34e68bae5e60 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:18.040152 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-794e730f-785f-49ba-b730-34e68bae5e60 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.153241 Aug 09 18:17:18.040707 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 129/245] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:17 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:18.422228 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-927a8979-557f-4efc-8f64-9a395cd2f140 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:18.422900 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-927a8979-557f-4efc-8f64-9a395cd2f140 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:18.429593 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-927a8979-557f-4efc-8f64-9a395cd2f140 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:18.430086 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-927a8979-557f-4efc-8f64-9a395cd2f140 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:18.430524 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-927a8979-557f-4efc-8f64-9a395cd2f140 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:18.431252 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-927a8979-557f-4efc-8f64-9a395cd2f140 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:18.431711 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-927a8979-557f-4efc-8f64-9a395cd2f140 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:18.432153 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-927a8979-557f-4efc-8f64-9a395cd2f140 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:18.563820 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-927a8979-557f-4efc-8f64-9a395cd2f140 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:18.573033 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-927a8979-557f-4efc-8f64-9a395cd2f140 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1552 microversion: 2.1 time: 0.154641 Aug 09 18:17:18.573290 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 117/246] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:18 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:19.063257 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-acbd9c24-a261-49a1-b972-56139fba230d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:19.063796 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-acbd9c24-a261-49a1-b972-56139fba230d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:19.070049 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-acbd9c24-a261-49a1-b972-56139fba230d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:19.070532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-acbd9c24-a261-49a1-b972-56139fba230d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:19.071000 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-acbd9c24-a261-49a1-b972-56139fba230d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:19.071687 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-acbd9c24-a261-49a1-b972-56139fba230d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:19.072313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-acbd9c24-a261-49a1-b972-56139fba230d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:19.072742 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-acbd9c24-a261-49a1-b972-56139fba230d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:19.209564 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-acbd9c24-a261-49a1-b972-56139fba230d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:19.217211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-acbd9c24-a261-49a1-b972-56139fba230d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.158253 Aug 09 18:17:19.217784 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 130/247] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:19 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:19.594883 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-3feb069e-1546-4851-9367-84aeb9d2542e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:19.596526 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-3feb069e-1546-4851-9367-84aeb9d2542e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:19.604471 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3feb069e-1546-4851-9367-84aeb9d2542e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:19.604960 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3feb069e-1546-4851-9367-84aeb9d2542e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:19.605396 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3feb069e-1546-4851-9367-84aeb9d2542e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:19.606164 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3feb069e-1546-4851-9367-84aeb9d2542e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:19.606551 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3feb069e-1546-4851-9367-84aeb9d2542e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:19.607162 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3feb069e-1546-4851-9367-84aeb9d2542e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:20.076240 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-3feb069e-1546-4851-9367-84aeb9d2542e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:20.086077 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-3feb069e-1546-4851-9367-84aeb9d2542e tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1552 microversion: 2.1 time: 0.495265 Aug 09 18:17:20.087475 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 118/248] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:19 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1552 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:20.240290 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-4835dddf-6cc2-41ed-afd4-393da54cb8b8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:20.240896 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-4835dddf-6cc2-41ed-afd4-393da54cb8b8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:20.246790 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4835dddf-6cc2-41ed-afd4-393da54cb8b8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:20.247277 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4835dddf-6cc2-41ed-afd4-393da54cb8b8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:20.247712 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4835dddf-6cc2-41ed-afd4-393da54cb8b8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:20.248455 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4835dddf-6cc2-41ed-afd4-393da54cb8b8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:20.248926 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4835dddf-6cc2-41ed-afd4-393da54cb8b8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:20.249465 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4835dddf-6cc2-41ed-afd4-393da54cb8b8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:20.396722 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4835dddf-6cc2-41ed-afd4-393da54cb8b8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:20.405556 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-4835dddf-6cc2-41ed-afd4-393da54cb8b8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.168210 Aug 09 18:17:20.406219 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 131/249] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:20 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:20.497088 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-4289a3d6-515f-4959-a395-e0f71c2ec5f8 req-00883fdb-b844-4d37-8a6d-aae9b79e9b59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e0ec306-6457-418d-8cd7-b86df41c026b", "name": "network-vif-deleted", "tag": "c00a6107-22ea-4149-ae88-6b763c07baf9"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:17:20.510812 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-4289a3d6-515f-4959-a395-e0f71c2ec5f8 req-00883fdb-b844-4d37-8a6d-aae9b79e9b59 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:20.510812 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-4289a3d6-515f-4959-a395-e0f71c2ec5f8 req-00883fdb-b844-4d37-8a6d-aae9b79e9b59 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:20.510812 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-4289a3d6-515f-4959-a395-e0f71c2ec5f8 req-00883fdb-b844-4d37-8a6d-aae9b79e9b59 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:20.530410 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-4289a3d6-515f-4959-a395-e0f71c2ec5f8 req-00883fdb-b844-4d37-8a6d-aae9b79e9b59 service nova] Creating event network-vif-deleted:c00a6107-22ea-4149-ae88-6b763c07baf9 for instance 2e0ec306-6457-418d-8cd7-b86df41c026b on hv-cinder-79797 Aug 09 18:17:20.536443 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-4289a3d6-515f-4959-a395-e0f71c2ec5f8 req-00883fdb-b844-4d37-8a6d-aae9b79e9b59 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043907 Aug 09 18:17:20.537394 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 119/250] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:17:21.109664 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e22ac122-2a76-4b77-bd84-756ffd1301b6 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:21.110341 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e22ac122-2a76-4b77-bd84-756ffd1301b6 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:21.116436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e22ac122-2a76-4b77-bd84-756ffd1301b6 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:21.116980 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e22ac122-2a76-4b77-bd84-756ffd1301b6 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:21.117423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e22ac122-2a76-4b77-bd84-756ffd1301b6 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:21.118114 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e22ac122-2a76-4b77-bd84-756ffd1301b6 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:21.118571 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e22ac122-2a76-4b77-bd84-756ffd1301b6 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:21.119020 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e22ac122-2a76-4b77-bd84-756ffd1301b6 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:21.183180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e22ac122-2a76-4b77-bd84-756ffd1301b6 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f405a8b7cd64c7e9615a528a0d2484b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad80b76c328d44aa9479a98367f0f65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:21.191499 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e22ac122-2a76-4b77-bd84-756ffd1301b6 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 200 len: 1345 microversion: 2.1 time: 0.086673 Aug 09 18:17:21.192141 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 132/251] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:21 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 1345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:21.427616 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-3897af8f-4886-40fd-98d6-1057b0a521f3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:21.428312 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-3897af8f-4886-40fd-98d6-1057b0a521f3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:21.434361 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3897af8f-4886-40fd-98d6-1057b0a521f3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:21.434908 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3897af8f-4886-40fd-98d6-1057b0a521f3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:21.435354 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3897af8f-4886-40fd-98d6-1057b0a521f3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:21.436720 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3897af8f-4886-40fd-98d6-1057b0a521f3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:21.437237 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3897af8f-4886-40fd-98d6-1057b0a521f3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:21.437697 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3897af8f-4886-40fd-98d6-1057b0a521f3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:21.574372 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-3897af8f-4886-40fd-98d6-1057b0a521f3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:21.581812 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-3897af8f-4886-40fd-98d6-1057b0a521f3 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.158845 Aug 09 18:17:21.582417 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 120/252] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:21 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:22.212084 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e7f85af2-f52c-49ee-8228-67f7ce1baeb9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:22.213257 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e7f85af2-f52c-49ee-8228-67f7ce1baeb9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:22.220035 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e7f85af2-f52c-49ee-8228-67f7ce1baeb9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:22.220525 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e7f85af2-f52c-49ee-8228-67f7ce1baeb9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:22.222845 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e7f85af2-f52c-49ee-8228-67f7ce1baeb9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:22.222845 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e7f85af2-f52c-49ee-8228-67f7ce1baeb9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:22.222845 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e7f85af2-f52c-49ee-8228-67f7ce1baeb9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:22.222845 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e7f85af2-f52c-49ee-8228-67f7ce1baeb9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:22.238334 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-e7f85af2-f52c-49ee-8228-67f7ce1baeb9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] HTTP exception thrown: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. Aug 09 18:17:22.242971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e7f85af2-f52c-49ee-8228-67f7ce1baeb9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Request method failure captured: Aug 09 18:17:22.242971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b HTTP/1.1 Aug 09 18:17:22.242971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:17:22.242971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:17:22.242971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:17:22.242971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:17:22.242971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:17:22.242971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:17:22.242971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:17:22.242971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:17:22.242971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qRFHCTPioB2zvqh0Ul20xPM-rkTwWyHu9njP8Ae7Dlq2ShmnM4BBiAaf7rkeSv42Vdw9CMNNZ9WPW4YHfJtz009KQtK8EylvBIE0NG9gWNBPNDaQ7TSp36vFieQv5q-TpFgmJCgQaH6ij8aFEIaqoPoUNdxp3Fi6Iqytdz-p5_23-0 Aug 09 18:17:22.242971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:17:22.242971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:17:22.242971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:17:22.242971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:17:22.242971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:17:22.242971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:17:22.242971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: ad80b76c328d44aa9479a98367f0f65c Aug 09 18:17:22.242971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-DeleteServersTestJSON-712297241 Aug 09 18:17:22.242971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:17:22.242971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:17:22.244654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad80b76c328d44aa9479a98367f0f65c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ad80b76c328d44aa9479a98367f0f65c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ad80b76c328d44aa9479a98367f0f65c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad80b76c328d44aa9479a98367f0f65c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:17:22.244654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-DeleteServersTestJSON-712297241 Aug 09 18:17:22.244654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: ad80b76c328d44aa9479a98367f0f65c Aug 09 18:17:22.244654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-DeleteServersTestJSON-712297241 Aug 09 18:17:22.244654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-DeleteServersTestJSON-712297241-project Aug 09 18:17:22.244654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:17:22.244654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:17:22.244654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: 5f405a8b7cd64c7e9615a528a0d2484b Aug 09 18:17:22.244654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-DeleteServersTestJSON-712297241-project Aug 09 18:17:22.244654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:17:22.244654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. Aug 09 18:17:22.244654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': '2e0ec306-6457-418d-8cd7-b86df41c026b'} Aug 09 18:17:22.245526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:17:22.245526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:22.245526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:17:22.245526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:17:22.245526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:17:22.245526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:17:22.245526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:17:22.245526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:17:22.245526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:17:22.245526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:17:22.245526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. Aug 09 18:17:22.245526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:17:22.245526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:17:22.245526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:17:22.245526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:22.245526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:17:22.245526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:17:22.245526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:17:22.245526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:17:22.245526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:17:22.247180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:17:22.247180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:17:22.247180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:17:22.247180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:17:22.247180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:17:22.247180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:17:22.247180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:17:22.247180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. Aug 09 18:17:22.247180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:17:22.247180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:17:22.247180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:17:22.247180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:22.247180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:17:22.247180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:17:22.247180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:17:22.247180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:17:22.247180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. Aug 09 18:17:22.247180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:17:22.249258 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e7f85af2-f52c-49ee-8228-67f7ce1baeb9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Returning 404 to user: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:17:22.249258 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e7f85af2-f52c-49ee-8228-67f7ce1baeb9 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 404 len: 111 microversion: 2.1 time: 0.036098 Aug 09 18:17:22.249258 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 133/253] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:22 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:17:22.359255 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-83da623c-311d-4ffb-914f-35c659cce719 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:22.361386 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-83da623c-311d-4ffb-914f-35c659cce719 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:22.367936 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-83da623c-311d-4ffb-914f-35c659cce719 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:22.368423 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-83da623c-311d-4ffb-914f-35c659cce719 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:22.368860 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-83da623c-311d-4ffb-914f-35c659cce719 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:22.369786 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-83da623c-311d-4ffb-914f-35c659cce719 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:22.371634 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-83da623c-311d-4ffb-914f-35c659cce719 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:22.371634 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-83da623c-311d-4ffb-914f-35c659cce719 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:22.384141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-83da623c-311d-4ffb-914f-35c659cce719 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] HTTP exception thrown: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. Aug 09 18:17:22.391133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-83da623c-311d-4ffb-914f-35c659cce719 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Request method failure captured: Aug 09 18:17:22.391133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b/os-volume_attachments HTTP/1.1 Aug 09 18:17:22.391133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:17:22.391133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:17:22.391133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:17:22.391133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 0 Aug 09 18:17:22.391133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:17:22.391133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:17:22.391133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:17:22.391133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:17:22.391133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qRFHCTPioB2zvqh0Ul20xPM-rkTwWyHu9njP8Ae7Dlq2ShmnM4BBiAaf7rkeSv42Vdw9CMNNZ9WPW4YHfJtz009KQtK8EylvBIE0NG9gWNBPNDaQ7TSp36vFieQv5q-TpFgmJCgQaH6ij8aFEIaqoPoUNdxp3Fi6Iqytdz-p5_23-0 Aug 09 18:17:22.391133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:17:22.391133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:17:22.391133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:17:22.391133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:17:22.391133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:17:22.391133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:17:22.391133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: ad80b76c328d44aa9479a98367f0f65c Aug 09 18:17:22.391133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-DeleteServersTestJSON-712297241 Aug 09 18:17:22.391133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:17:22.391133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:17:22.392530 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad80b76c328d44aa9479a98367f0f65c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ad80b76c328d44aa9479a98367f0f65c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ad80b76c328d44aa9479a98367f0f65c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad80b76c328d44aa9479a98367f0f65c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:17:22.392530 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-DeleteServersTestJSON-712297241 Aug 09 18:17:22.392530 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: ad80b76c328d44aa9479a98367f0f65c Aug 09 18:17:22.392530 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-DeleteServersTestJSON-712297241 Aug 09 18:17:22.392530 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-DeleteServersTestJSON-712297241-project Aug 09 18:17:22.392530 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:17:22.392530 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:17:22.392530 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: 5f405a8b7cd64c7e9615a528a0d2484b Aug 09 18:17:22.392530 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-DeleteServersTestJSON-712297241-project Aug 09 18:17:22.392530 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: > Aug 09 18:17:22.392530 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. Aug 09 18:17:22.392530 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'server_id': '2e0ec306-6457-418d-8cd7-b86df41c026b'} Aug 09 18:17:22.393306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:17:22.393306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:22.393306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:17:22.393306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:17:22.393306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:17:22.393306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:17:22.393306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:17:22.393306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:17:22.393306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:17:22.393306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:17:22.393306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. Aug 09 18:17:22.393306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:17:22.393306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:17:22.393306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:17:22.393306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:22.393306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:17:22.393306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:17:22.393306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:17:22.393306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:17:22.393306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:17:22.394573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:17:22.394573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 18:17:22.394573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:17:22.394573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 18:17:22.394573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:17:22.394573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 09 18:17:22.394573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 09 18:17:22.394573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:17:22.394573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:17:22.394573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. Aug 09 18:17:22.394573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:17:22.394573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:17:22.394573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:17:22.394573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:22.394573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:17:22.394573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:17:22.394573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:17:22.394573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:17:22.394573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. Aug 09 18:17:22.394573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:17:22.401289 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-83da623c-311d-4ffb-914f-35c659cce719 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Returning 404 to user: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:17:22.401289 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-83da623c-311d-4ffb-914f-35c659cce719 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039619 Aug 09 18:17:22.401289 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 121/254] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Aug 9 18:17:22 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:17:22.604499 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-574c1108-a88a-46fe-b0d1-9fe99bc3404e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:22.605366 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-574c1108-a88a-46fe-b0d1-9fe99bc3404e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:22.612982 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-574c1108-a88a-46fe-b0d1-9fe99bc3404e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:22.613481 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-574c1108-a88a-46fe-b0d1-9fe99bc3404e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:22.613908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-574c1108-a88a-46fe-b0d1-9fe99bc3404e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:22.614601 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-574c1108-a88a-46fe-b0d1-9fe99bc3404e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:22.615069 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-574c1108-a88a-46fe-b0d1-9fe99bc3404e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:22.615645 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-574c1108-a88a-46fe-b0d1-9fe99bc3404e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:22.775029 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-574c1108-a88a-46fe-b0d1-9fe99bc3404e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:22.784677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-574c1108-a88a-46fe-b0d1-9fe99bc3404e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.184635 Aug 09 18:17:22.785113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 134/255] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:22 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:23.806250 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-62f39f25-cb69-4da9-9327-87c23c6b9c11 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:23.811184 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-62f39f25-cb69-4da9-9327-87c23c6b9c11 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:23.814163 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-62f39f25-cb69-4da9-9327-87c23c6b9c11 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:23.814806 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-62f39f25-cb69-4da9-9327-87c23c6b9c11 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:23.815314 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-62f39f25-cb69-4da9-9327-87c23c6b9c11 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:23.816148 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-62f39f25-cb69-4da9-9327-87c23c6b9c11 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:23.816681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-62f39f25-cb69-4da9-9327-87c23c6b9c11 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:23.817236 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-62f39f25-cb69-4da9-9327-87c23c6b9c11 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:23.850611 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2190d4c7-796e-4562-8d48-f02067c33925 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:23.851503 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-2190d4c7-796e-4562-8d48-f02067c33925 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:23.858579 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2190d4c7-796e-4562-8d48-f02067c33925 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:23.859487 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2190d4c7-796e-4562-8d48-f02067c33925 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:23.866203 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2190d4c7-796e-4562-8d48-f02067c33925 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:23.866203 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2190d4c7-796e-4562-8d48-f02067c33925 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:23.866203 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2190d4c7-796e-4562-8d48-f02067c33925 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:23.866203 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2190d4c7-796e-4562-8d48-f02067c33925 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:23.875313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-2190d4c7-796e-4562-8d48-f02067c33925 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] HTTP exception thrown: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. Aug 09 18:17:23.876925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2190d4c7-796e-4562-8d48-f02067c33925 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Request method failure captured: Aug 09 18:17:23.876925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: DELETE /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b HTTP/1.1 Aug 09 18:17:23.876925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:17:23.876925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:17:23.876925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:17:23.876925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:17:23.876925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:17:23.876925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:17:23.876925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:17:23.876925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:17:23.876925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qRFHCTPioB2zvqh0Ul20xPM-rkTwWyHu9njP8Ae7Dlq2ShmnM4BBiAaf7rkeSv42Vdw9CMNNZ9WPW4YHfJtz009KQtK8EylvBIE0NG9gWNBPNDaQ7TSp36vFieQv5q-TpFgmJCgQaH6ij8aFEIaqoPoUNdxp3Fi6Iqytdz-p5_23-0 Aug 09 18:17:23.876925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:17:23.876925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:17:23.876925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:17:23.876925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:17:23.876925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:17:23.876925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:17:23.876925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: ad80b76c328d44aa9479a98367f0f65c Aug 09 18:17:23.876925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-DeleteServersTestJSON-712297241 Aug 09 18:17:23.876925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:17:23.876925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:17:23.878397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad80b76c328d44aa9479a98367f0f65c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ad80b76c328d44aa9479a98367f0f65c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ad80b76c328d44aa9479a98367f0f65c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad80b76c328d44aa9479a98367f0f65c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:17:23.878397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-DeleteServersTestJSON-712297241 Aug 09 18:17:23.878397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: ad80b76c328d44aa9479a98367f0f65c Aug 09 18:17:23.878397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-DeleteServersTestJSON-712297241 Aug 09 18:17:23.878397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-DeleteServersTestJSON-712297241-project Aug 09 18:17:23.878397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:17:23.878397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:17:23.878397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: 5f405a8b7cd64c7e9615a528a0d2484b Aug 09 18:17:23.878397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-DeleteServersTestJSON-712297241-project Aug 09 18:17:23.878397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:17:23.878397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. Aug 09 18:17:23.878397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': '2e0ec306-6457-418d-8cd7-b86df41c026b'} Aug 09 18:17:23.879344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:17:23.879344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:23.879344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:17:23.879344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:17:23.879344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:17:23.879344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:17:23.879344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:17:23.879344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:17:23.879344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:17:23.879344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:17:23.879344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. Aug 09 18:17:23.879344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:17:23.879344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:17:23.879344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:17:23.879344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:23.879344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:17:23.879344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:17:23.879344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:17:23.879344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:17:23.879344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:17:23.880654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:17:23.880654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:17:23.880654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:17:23.880654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:17:23.880654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:17:23.880654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:17:23.880654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:17:23.880654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:17:23.880654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:17:23.880654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. Aug 09 18:17:23.880654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:17:23.880654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:17:23.880654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:17:23.880654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:23.880654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:17:23.880654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:17:23.880654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:17:23.880654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:17:23.880654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. Aug 09 18:17:23.880654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:17:23.881769 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2190d4c7-796e-4562-8d48-f02067c33925 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Returning 404 to user: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:17:23.881769 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-2190d4c7-796e-4562-8d48-f02067c33925 tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 404 len: 111 microversion: 2.1 time: 0.032026 Aug 09 18:17:23.881769 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 135/256] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:17:23 2022] DELETE /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:17:23.887451 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-12d55fce-f9f8-4baa-a5d2-349c5e8d4c6b tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:23.888190 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-12d55fce-f9f8-4baa-a5d2-349c5e8d4c6b tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] [instance: 2e0ec306-6457-418d-8cd7-b86df41c026b] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:23.894183 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-12d55fce-f9f8-4baa-a5d2-349c5e8d4c6b tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:23.894669 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-12d55fce-f9f8-4baa-a5d2-349c5e8d4c6b tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:23.895137 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-12d55fce-f9f8-4baa-a5d2-349c5e8d4c6b tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:23.895831 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-12d55fce-f9f8-4baa-a5d2-349c5e8d4c6b tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:23.897374 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-12d55fce-f9f8-4baa-a5d2-349c5e8d4c6b tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:23.897374 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-12d55fce-f9f8-4baa-a5d2-349c5e8d4c6b tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:23.911400 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-12d55fce-f9f8-4baa-a5d2-349c5e8d4c6b tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] HTTP exception thrown: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. Aug 09 18:17:23.913122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-12d55fce-f9f8-4baa-a5d2-349c5e8d4c6b tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Request method failure captured: Aug 09 18:17:23.913122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b HTTP/1.1 Aug 09 18:17:23.913122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:17:23.913122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:17:23.913122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:17:23.913122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:17:23.913122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:17:23.913122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:17:23.913122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:17:23.913122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:17:23.913122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qRFHCTPioB2zvqh0Ul20xPM-rkTwWyHu9njP8Ae7Dlq2ShmnM4BBiAaf7rkeSv42Vdw9CMNNZ9WPW4YHfJtz009KQtK8EylvBIE0NG9gWNBPNDaQ7TSp36vFieQv5q-TpFgmJCgQaH6ij8aFEIaqoPoUNdxp3Fi6Iqytdz-p5_23-0 Aug 09 18:17:23.913122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:17:23.913122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:17:23.913122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:17:23.913122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:17:23.913122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:17:23.913122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:17:23.913122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: ad80b76c328d44aa9479a98367f0f65c Aug 09 18:17:23.913122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-DeleteServersTestJSON-712297241 Aug 09 18:17:23.913122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:17:23.913122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:17:23.914538 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad80b76c328d44aa9479a98367f0f65c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ad80b76c328d44aa9479a98367f0f65c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ad80b76c328d44aa9479a98367f0f65c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad80b76c328d44aa9479a98367f0f65c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:17:23.914538 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-DeleteServersTestJSON-712297241 Aug 09 18:17:23.914538 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: ad80b76c328d44aa9479a98367f0f65c Aug 09 18:17:23.914538 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-DeleteServersTestJSON-712297241 Aug 09 18:17:23.914538 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-DeleteServersTestJSON-712297241-project Aug 09 18:17:23.914538 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:17:23.914538 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:17:23.914538 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: 5f405a8b7cd64c7e9615a528a0d2484b Aug 09 18:17:23.914538 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-DeleteServersTestJSON-712297241-project Aug 09 18:17:23.914538 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:17:23.914538 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. Aug 09 18:17:23.914538 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': '2e0ec306-6457-418d-8cd7-b86df41c026b'} Aug 09 18:17:23.921244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:17:23.921244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:23.921244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:17:23.921244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:17:23.921244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:17:23.921244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:17:23.921244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:17:23.921244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:17:23.921244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:17:23.921244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:17:23.921244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. Aug 09 18:17:23.921244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:17:23.921244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:17:23.921244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:17:23.921244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:23.921244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:17:23.921244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:17:23.921244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:17:23.921244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:17:23.921244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:17:23.922683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:17:23.922683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:17:23.922683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:17:23.922683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:17:23.922683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:17:23.922683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:17:23.922683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:17:23.922683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. Aug 09 18:17:23.922683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:17:23.922683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:17:23.922683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:17:23.922683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:23.922683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:17:23.922683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:17:23.922683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:17:23.922683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:17:23.922683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. Aug 09 18:17:23.922683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:17:23.923863 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-12d55fce-f9f8-4baa-a5d2-349c5e8d4c6b tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] Returning 404 to user: Instance 2e0ec306-6457-418d-8cd7-b86df41c026b could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:17:23.923863 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-12d55fce-f9f8-4baa-a5d2-349c5e8d4c6b tempest-DeleteServersTestJSON-712297241 tempest-DeleteServersTestJSON-712297241-project] 10.222.0.36 "GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b" status: 404 len: 111 microversion: 2.1 time: 0.031006 Aug 09 18:17:23.923863 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 136/257] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:23 2022] GET /compute/v2.1/servers/2e0ec306-6457-418d-8cd7-b86df41c026b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:17:23.993818 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-62f39f25-cb69-4da9-9327-87c23c6b9c11 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:23.997533 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:17:24.002419 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-62f39f25-cb69-4da9-9327-87c23c6b9c11 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.200319 Aug 09 18:17:24.003024 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 122/258] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:23 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:25.022231 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-88dfe3e7-96d5-4605-80f5-8e8700fafa64 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:25.023716 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-88dfe3e7-96d5-4605-80f5-8e8700fafa64 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:25.030271 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-88dfe3e7-96d5-4605-80f5-8e8700fafa64 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:25.030787 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-88dfe3e7-96d5-4605-80f5-8e8700fafa64 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:25.031541 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-88dfe3e7-96d5-4605-80f5-8e8700fafa64 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:25.032239 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-88dfe3e7-96d5-4605-80f5-8e8700fafa64 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:25.040139 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-88dfe3e7-96d5-4605-80f5-8e8700fafa64 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:25.041979 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-88dfe3e7-96d5-4605-80f5-8e8700fafa64 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:25.261782 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-88dfe3e7-96d5-4605-80f5-8e8700fafa64 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:25.271330 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-88dfe3e7-96d5-4605-80f5-8e8700fafa64 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.252873 Aug 09 18:17:25.274748 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 137/259] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:25 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:26.293519 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-29e6017e-32e6-44bf-92c3-1d71a3253069 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:26.294890 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-29e6017e-32e6-44bf-92c3-1d71a3253069 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:26.301710 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-29e6017e-32e6-44bf-92c3-1d71a3253069 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:26.302188 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-29e6017e-32e6-44bf-92c3-1d71a3253069 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:26.302622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-29e6017e-32e6-44bf-92c3-1d71a3253069 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:26.304842 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-29e6017e-32e6-44bf-92c3-1d71a3253069 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:26.305304 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-29e6017e-32e6-44bf-92c3-1d71a3253069 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:26.305730 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-29e6017e-32e6-44bf-92c3-1d71a3253069 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:26.490358 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-29e6017e-32e6-44bf-92c3-1d71a3253069 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:26.498018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-29e6017e-32e6-44bf-92c3-1d71a3253069 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.208749 Aug 09 18:17:26.502228 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 123/260] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:26 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:27.527511 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-04ec3ae9-5212-446d-b5a0-f2e75a938ba8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:27.528818 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-04ec3ae9-5212-446d-b5a0-f2e75a938ba8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:27.541526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-04ec3ae9-5212-446d-b5a0-f2e75a938ba8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:27.543395 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-04ec3ae9-5212-446d-b5a0-f2e75a938ba8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:27.544414 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-04ec3ae9-5212-446d-b5a0-f2e75a938ba8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:27.556082 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-04ec3ae9-5212-446d-b5a0-f2e75a938ba8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:27.556082 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-04ec3ae9-5212-446d-b5a0-f2e75a938ba8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:27.561353 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-04ec3ae9-5212-446d-b5a0-f2e75a938ba8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:27.808549 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-04ec3ae9-5212-446d-b5a0-f2e75a938ba8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:27.819093 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-04ec3ae9-5212-446d-b5a0-f2e75a938ba8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.301760 Aug 09 18:17:27.819801 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 138/261] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:27 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:28.840631 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-999c7cf6-3845-4405-a1d6-30a9bb50254a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:28.841942 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-999c7cf6-3845-4405-a1d6-30a9bb50254a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:28.851099 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-999c7cf6-3845-4405-a1d6-30a9bb50254a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:28.851685 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-999c7cf6-3845-4405-a1d6-30a9bb50254a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:28.852358 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-999c7cf6-3845-4405-a1d6-30a9bb50254a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:28.853100 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-999c7cf6-3845-4405-a1d6-30a9bb50254a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:28.853587 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-999c7cf6-3845-4405-a1d6-30a9bb50254a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:28.854119 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-999c7cf6-3845-4405-a1d6-30a9bb50254a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:29.013517 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-999c7cf6-3845-4405-a1d6-30a9bb50254a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:29.028000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-999c7cf6-3845-4405-a1d6-30a9bb50254a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.191142 Aug 09 18:17:29.028722 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 124/262] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:28 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:30.050345 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-49e24cb5-ab16-48cd-add0-b2980e01431e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:30.050975 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-49e24cb5-ab16-48cd-add0-b2980e01431e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:30.057373 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-49e24cb5-ab16-48cd-add0-b2980e01431e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:30.057946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-49e24cb5-ab16-48cd-add0-b2980e01431e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:30.058445 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-49e24cb5-ab16-48cd-add0-b2980e01431e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:30.059367 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-49e24cb5-ab16-48cd-add0-b2980e01431e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:30.060030 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-49e24cb5-ab16-48cd-add0-b2980e01431e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:30.060640 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-49e24cb5-ab16-48cd-add0-b2980e01431e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:30.204978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-49e24cb5-ab16-48cd-add0-b2980e01431e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:30.213013 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-49e24cb5-ab16-48cd-add0-b2980e01431e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.167236 Aug 09 18:17:30.221437 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 139/263] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:30 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:31.234910 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-b7c0287a-df0d-492a-9779-ef77a3878b9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:31.235533 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-b7c0287a-df0d-492a-9779-ef77a3878b9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:31.242479 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b7c0287a-df0d-492a-9779-ef77a3878b9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:31.243010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b7c0287a-df0d-492a-9779-ef77a3878b9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:31.243496 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b7c0287a-df0d-492a-9779-ef77a3878b9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:31.244260 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b7c0287a-df0d-492a-9779-ef77a3878b9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:31.244741 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b7c0287a-df0d-492a-9779-ef77a3878b9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:31.245194 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b7c0287a-df0d-492a-9779-ef77a3878b9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:31.464207 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-b7c0287a-df0d-492a-9779-ef77a3878b9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:31.472812 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-b7c0287a-df0d-492a-9779-ef77a3878b9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.242259 Aug 09 18:17:31.475417 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 125/264] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:31 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:32.494760 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f20559f2-d496-4a9c-8e82-5e400d10091c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:32.495352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f20559f2-d496-4a9c-8e82-5e400d10091c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:32.501444 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f20559f2-d496-4a9c-8e82-5e400d10091c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:32.501947 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f20559f2-d496-4a9c-8e82-5e400d10091c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:32.502390 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f20559f2-d496-4a9c-8e82-5e400d10091c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:32.503124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f20559f2-d496-4a9c-8e82-5e400d10091c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:32.503584 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f20559f2-d496-4a9c-8e82-5e400d10091c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:32.504009 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f20559f2-d496-4a9c-8e82-5e400d10091c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:32.733361 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f20559f2-d496-4a9c-8e82-5e400d10091c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:32.755733 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f20559f2-d496-4a9c-8e82-5e400d10091c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.264514 Aug 09 18:17:32.765029 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 140/265] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:32 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:33.791631 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-65893056-361c-4438-b5e2-8f6ab5c9f848 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:33.798628 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-65893056-361c-4438-b5e2-8f6ab5c9f848 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:33.799584 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-65893056-361c-4438-b5e2-8f6ab5c9f848 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:33.800085 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-65893056-361c-4438-b5e2-8f6ab5c9f848 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:33.800519 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-65893056-361c-4438-b5e2-8f6ab5c9f848 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:33.801388 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-65893056-361c-4438-b5e2-8f6ab5c9f848 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:33.802026 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-65893056-361c-4438-b5e2-8f6ab5c9f848 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:33.802452 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-65893056-361c-4438-b5e2-8f6ab5c9f848 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:34.254291 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-65893056-361c-4438-b5e2-8f6ab5c9f848 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:34.266376 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-65893056-361c-4438-b5e2-8f6ab5c9f848 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.485954 Aug 09 18:17:34.267006 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 126/266] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:33 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:35.291655 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-af2fa279-ddd8-4ff0-b674-e432aec36521 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:35.292916 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-af2fa279-ddd8-4ff0-b674-e432aec36521 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:35.299322 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:17:35.301186 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-af2fa279-ddd8-4ff0-b674-e432aec36521 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:35.301904 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-af2fa279-ddd8-4ff0-b674-e432aec36521 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:35.302544 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-af2fa279-ddd8-4ff0-b674-e432aec36521 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:35.303460 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-af2fa279-ddd8-4ff0-b674-e432aec36521 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:35.304105 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-af2fa279-ddd8-4ff0-b674-e432aec36521 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:35.304717 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-af2fa279-ddd8-4ff0-b674-e432aec36521 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:35.543396 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-af2fa279-ddd8-4ff0-b674-e432aec36521 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:35.551322 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-af2fa279-ddd8-4ff0-b674-e432aec36521 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.264511 Aug 09 18:17:35.552120 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 141/267] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:35 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:36.572809 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-79bb884c-0dea-4bfd-b1f0-b9d80ff9c65a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:36.574303 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-79bb884c-0dea-4bfd-b1f0-b9d80ff9c65a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:36.580947 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=34 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:17:36.582965 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79bb884c-0dea-4bfd-b1f0-b9d80ff9c65a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:36.583705 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79bb884c-0dea-4bfd-b1f0-b9d80ff9c65a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:36.584203 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79bb884c-0dea-4bfd-b1f0-b9d80ff9c65a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:36.584964 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79bb884c-0dea-4bfd-b1f0-b9d80ff9c65a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:36.585638 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79bb884c-0dea-4bfd-b1f0-b9d80ff9c65a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:36.586265 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79bb884c-0dea-4bfd-b1f0-b9d80ff9c65a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:36.780934 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-79bb884c-0dea-4bfd-b1f0-b9d80ff9c65a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:36.789598 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-79bb884c-0dea-4bfd-b1f0-b9d80ff9c65a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.220410 Aug 09 18:17:36.806745 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 127/268] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:36 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:37.368783 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-04f996fe-4e06-48da-aebb-213d69092582 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Action: 'create', calling method: .version_select at 0x7f4c35d61dc0>, body: {"keypair": {"name": "tempest-keypair-1979419076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtz0jxC/5gvQNCinc8b62DjF/Pd3cIeFMQw8xnGZfkf46bUVKvIoD3x58g1XCtMCAw81IH70AWe1VWw/lYF5cEAyc+2wtli9rLpAxx9txisB4PSviL9DCS5hS6/MFtqOA=="}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:17:37.394230 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-04f996fe-4e06-48da-aebb-213d69092582 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Getting quotas for project b23fb97c7c4049c49f6bad8418fc4dec. Resources: {'key_pairs'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:17:37.407121 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-04f996fe-4e06-48da-aebb-213d69092582 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Getting quotas for user a6c7401eaf744ef895bacc294f7c6268 and project b23fb97c7c4049c49f6bad8418fc4dec. Resources: {'key_pairs'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:17:37.512067 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-04f996fe-4e06-48da-aebb-213d69092582 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.348420 Aug 09 18:17:37.512728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 142/269] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Aug 9 18:17:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:17:37.822945 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-555b25f9-e0a4-44a0-a24f-dabe96f39900 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:37.824326 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-555b25f9-e0a4-44a0-a24f-dabe96f39900 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:37.831863 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-555b25f9-e0a4-44a0-a24f-dabe96f39900 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:37.832450 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-555b25f9-e0a4-44a0-a24f-dabe96f39900 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:37.833204 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-555b25f9-e0a4-44a0-a24f-dabe96f39900 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:37.833986 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-555b25f9-e0a4-44a0-a24f-dabe96f39900 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:37.834625 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-555b25f9-e0a4-44a0-a24f-dabe96f39900 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:37.835090 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-555b25f9-e0a4-44a0-a24f-dabe96f39900 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:38.053752 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-555b25f9-e0a4-44a0-a24f-dabe96f39900 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:38.062428 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-555b25f9-e0a4-44a0-a24f-dabe96f39900 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.246690 Aug 09 18:17:38.063451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 128/270] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:37 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:39.088405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-50f03f85-9bf3-443e-a025-ea89ca26b29f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:39.094608 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-50f03f85-9bf3-443e-a025-ea89ca26b29f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:39.100733 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-50f03f85-9bf3-443e-a025-ea89ca26b29f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:39.101492 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-50f03f85-9bf3-443e-a025-ea89ca26b29f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:39.101811 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-50f03f85-9bf3-443e-a025-ea89ca26b29f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:39.102522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-50f03f85-9bf3-443e-a025-ea89ca26b29f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:39.103451 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-50f03f85-9bf3-443e-a025-ea89ca26b29f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:39.103960 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-50f03f85-9bf3-443e-a025-ea89ca26b29f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:39.361648 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-50f03f85-9bf3-443e-a025-ea89ca26b29f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:39.369249 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-50f03f85-9bf3-443e-a025-ea89ca26b29f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.284759 Aug 09 18:17:39.374791 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 143/271] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:39 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:40.396125 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c5876756-c1db-40b0-a2be-974ec9e54a24 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:40.396869 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c5876756-c1db-40b0-a2be-974ec9e54a24 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:40.404329 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5876756-c1db-40b0-a2be-974ec9e54a24 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:40.404774 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5876756-c1db-40b0-a2be-974ec9e54a24 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:40.405232 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5876756-c1db-40b0-a2be-974ec9e54a24 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:40.406449 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5876756-c1db-40b0-a2be-974ec9e54a24 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:40.406950 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5876756-c1db-40b0-a2be-974ec9e54a24 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:40.407408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5876756-c1db-40b0-a2be-974ec9e54a24 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:40.570079 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c5876756-c1db-40b0-a2be-974ec9e54a24 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:40.586525 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c5876756-c1db-40b0-a2be-974ec9e54a24 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.191391 Aug 09 18:17:40.588217 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 129/272] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:40 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:40.621332 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-31129349-435b-4ea4-8ec1-cde7f9841820 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1828669749", "imageRef": "53732c26-c942-4646-ac3f-8d9e11ab4d57", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe6eacbf-4230-4c49-b44c-fd306b86f924"}], "security_groups": [{"name": "tempest-securitygroup--1929177380"}], "key_name": "tempest-keypair-1979419076", "user_data": "}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:17:41.612524 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-9a061b17-d49f-4d9a-bada-41cf164b6d7a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:41.614490 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-9a061b17-d49f-4d9a-bada-41cf164b6d7a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:41.626123 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9a061b17-d49f-4d9a-bada-41cf164b6d7a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:41.626772 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9a061b17-d49f-4d9a-bada-41cf164b6d7a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:41.627445 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9a061b17-d49f-4d9a-bada-41cf164b6d7a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:41.628233 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9a061b17-d49f-4d9a-bada-41cf164b6d7a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:41.628907 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9a061b17-d49f-4d9a-bada-41cf164b6d7a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:41.629592 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9a061b17-d49f-4d9a-bada-41cf164b6d7a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:41.952968 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-9a061b17-d49f-4d9a-bada-41cf164b6d7a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:42.008930 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-9a061b17-d49f-4d9a-bada-41cf164b6d7a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.402239 Aug 09 18:17:42.017437 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 130/273] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:41 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:43.041378 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-19c9edc6-c59c-4c10-b33f-2036d0d86fb5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:43.043756 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-19c9edc6-c59c-4c10-b33f-2036d0d86fb5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:43.059417 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-19c9edc6-c59c-4c10-b33f-2036d0d86fb5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:43.059805 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-19c9edc6-c59c-4c10-b33f-2036d0d86fb5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:43.060417 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-19c9edc6-c59c-4c10-b33f-2036d0d86fb5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:43.061862 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-19c9edc6-c59c-4c10-b33f-2036d0d86fb5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:43.063112 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-19c9edc6-c59c-4c10-b33f-2036d0d86fb5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:43.065762 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-19c9edc6-c59c-4c10-b33f-2036d0d86fb5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:43.228244 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-19c9edc6-c59c-4c10-b33f-2036d0d86fb5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:43.238527 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-19c9edc6-c59c-4c10-b33f-2036d0d86fb5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.204558 Aug 09 18:17:43.239143 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 131/274] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:43 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:44.259477 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-0855a9e5-5635-4cb6-8d43-79982cb28873 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:44.260229 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-0855a9e5-5635-4cb6-8d43-79982cb28873 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:44.267516 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0855a9e5-5635-4cb6-8d43-79982cb28873 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:44.268003 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0855a9e5-5635-4cb6-8d43-79982cb28873 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:44.270041 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0855a9e5-5635-4cb6-8d43-79982cb28873 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:44.270041 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0855a9e5-5635-4cb6-8d43-79982cb28873 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:44.270041 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0855a9e5-5635-4cb6-8d43-79982cb28873 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:44.270041 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0855a9e5-5635-4cb6-8d43-79982cb28873 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:44.455034 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-0855a9e5-5635-4cb6-8d43-79982cb28873 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:44.469986 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-0855a9e5-5635-4cb6-8d43-79982cb28873 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.214356 Aug 09 18:17:44.470795 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 132/275] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:44 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:45.492952 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-b2cb1d7c-260e-4f55-8a06-dbcdbbafea60 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:45.493610 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-b2cb1d7c-260e-4f55-8a06-dbcdbbafea60 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:45.500778 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b2cb1d7c-260e-4f55-8a06-dbcdbbafea60 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:45.501321 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b2cb1d7c-260e-4f55-8a06-dbcdbbafea60 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:45.502135 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b2cb1d7c-260e-4f55-8a06-dbcdbbafea60 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:45.503448 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b2cb1d7c-260e-4f55-8a06-dbcdbbafea60 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:45.504057 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b2cb1d7c-260e-4f55-8a06-dbcdbbafea60 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:45.504640 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b2cb1d7c-260e-4f55-8a06-dbcdbbafea60 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:45.757994 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.network.neutron [None req-31129349-435b-4ea4-8ec1-cde7f9841820 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] validate_networks() for [('fe6eacbf-4230-4c49-b44c-fd306b86f924', None, None, None, None, None)] {{(pid=118313) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:17:45.848492 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-b2cb1d7c-260e-4f55-8a06-dbcdbbafea60 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:45.860812 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-b2cb1d7c-260e-4f55-8a06-dbcdbbafea60 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.370287 Aug 09 18:17:45.862681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 133/276] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:45 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:46.284989 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-31129349-435b-4ea4-8ec1-cde7f9841820 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Flavor limits 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:17:46.285695 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-31129349-435b-4ea4-8ec1-cde7f9841820 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Image limits 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:17:46.286265 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-31129349-435b-4ea4-8ec1-cde7f9841820 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Flavor pref 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:17:46.286949 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-31129349-435b-4ea4-8ec1-cde7f9841820 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Image pref 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:17:46.287649 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-31129349-435b-4ea4-8ec1-cde7f9841820 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:17:46.298029 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-31129349-435b-4ea4-8ec1-cde7f9841820 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:46.298658 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-31129349-435b-4ea4-8ec1-cde7f9841820 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:46.299133 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-31129349-435b-4ea4-8ec1-cde7f9841820 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:46.300089 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-31129349-435b-4ea4-8ec1-cde7f9841820 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:46.300699 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-31129349-435b-4ea4-8ec1-cde7f9841820 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:46.301281 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-31129349-435b-4ea4-8ec1-cde7f9841820 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:46.324053 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-31129349-435b-4ea4-8ec1-cde7f9841820 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Getting quotas for project b23fb97c7c4049c49f6bad8418fc4dec. Resources: {'cores', 'instances', 'ram'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:17:46.329170 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-31129349-435b-4ea4-8ec1-cde7f9841820 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Getting quotas for user a6c7401eaf744ef895bacc294f7c6268 and project b23fb97c7c4049c49f6bad8418fc4dec. Resources: {'cores', 'instances', 'ram'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:17:46.341003 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-31129349-435b-4ea4-8ec1-cde7f9841820 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Going to run 1 instances... {{(pid=118313) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:17:46.343953 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-31129349-435b-4ea4-8ec1-cde7f9841820 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53732c26-c942-4646-ac3f-8d9e11ab4d57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118313) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:17:46.538186 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-31129349-435b-4ea4-8ec1-cde7f9841820 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.910512 Aug 09 18:17:46.539157 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 144/277] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Aug 9 18:17:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 5923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:17:46.554485 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8b8f94dc-2f9b-4315-96d0-70e3cb4d2e21 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:46.556152 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8b8f94dc-2f9b-4315-96d0-70e3cb4d2e21 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:46.628592 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8b8f94dc-2f9b-4315-96d0-70e3cb4d2e21 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:46.635397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8b8f94dc-2f9b-4315-96d0-70e3cb4d2e21 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1238 microversion: 2.1 time: 0.089214 Aug 09 18:17:46.636089 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 134/278] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:46 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1238 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:46.882720 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-302b1ea1-c9a5-4f71-a670-3b1d9fd76bb9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:46.883400 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-302b1ea1-c9a5-4f71-a670-3b1d9fd76bb9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:46.891999 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-302b1ea1-c9a5-4f71-a670-3b1d9fd76bb9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:46.892498 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-302b1ea1-c9a5-4f71-a670-3b1d9fd76bb9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:46.900320 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-302b1ea1-c9a5-4f71-a670-3b1d9fd76bb9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:46.900320 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-302b1ea1-c9a5-4f71-a670-3b1d9fd76bb9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:46.900320 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-302b1ea1-c9a5-4f71-a670-3b1d9fd76bb9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:46.900320 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-302b1ea1-c9a5-4f71-a670-3b1d9fd76bb9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:47.050728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-302b1ea1-c9a5-4f71-a670-3b1d9fd76bb9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:47.058227 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-302b1ea1-c9a5-4f71-a670-3b1d9fd76bb9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.179453 Aug 09 18:17:47.058818 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 145/279] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:46 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:47.658255 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-4c916d70-e8ea-466d-87a5-a70242f6bd12 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:47.658950 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-4c916d70-e8ea-466d-87a5-a70242f6bd12 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:47.723291 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-4c916d70-e8ea-466d-87a5-a70242f6bd12 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:47.732317 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-4c916d70-e8ea-466d-87a5-a70242f6bd12 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1238 microversion: 2.1 time: 0.078702 Aug 09 18:17:47.733352 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 135/280] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:47 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1238 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:48.083062 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d60b845f-623b-4775-8274-54f3edb0f8ef tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:48.083746 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d60b845f-623b-4775-8274-54f3edb0f8ef tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:48.090362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d60b845f-623b-4775-8274-54f3edb0f8ef tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:48.091294 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d60b845f-623b-4775-8274-54f3edb0f8ef tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:48.096009 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d60b845f-623b-4775-8274-54f3edb0f8ef tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:48.099352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d60b845f-623b-4775-8274-54f3edb0f8ef tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:48.099917 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d60b845f-623b-4775-8274-54f3edb0f8ef tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:48.100691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d60b845f-623b-4775-8274-54f3edb0f8ef tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:48.355171 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d60b845f-623b-4775-8274-54f3edb0f8ef tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:48.363372 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d60b845f-623b-4775-8274-54f3edb0f8ef tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.286691 Aug 09 18:17:48.364330 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 146/281] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:48 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:48.754919 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-74aaabfd-fe0e-48eb-b760-e241601aa87a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:48.755587 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-74aaabfd-fe0e-48eb-b760-e241601aa87a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:48.762257 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-74aaabfd-fe0e-48eb-b760-e241601aa87a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:48.762761 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-74aaabfd-fe0e-48eb-b760-e241601aa87a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:48.763190 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-74aaabfd-fe0e-48eb-b760-e241601aa87a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:48.763869 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-74aaabfd-fe0e-48eb-b760-e241601aa87a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:48.764320 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-74aaabfd-fe0e-48eb-b760-e241601aa87a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:48.764742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-74aaabfd-fe0e-48eb-b760-e241601aa87a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:48.830279 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-74aaabfd-fe0e-48eb-b760-e241601aa87a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:48.837893 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-74aaabfd-fe0e-48eb-b760-e241601aa87a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1234 microversion: 2.1 time: 0.086981 Aug 09 18:17:48.838464 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 136/282] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:48 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1234 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:49.384475 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-ba3203a7-1326-4ea1-a337-0653d328cbb5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:49.385086 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-ba3203a7-1326-4ea1-a337-0653d328cbb5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:49.391827 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ba3203a7-1326-4ea1-a337-0653d328cbb5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:49.392345 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ba3203a7-1326-4ea1-a337-0653d328cbb5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:49.395920 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ba3203a7-1326-4ea1-a337-0653d328cbb5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:49.395920 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ba3203a7-1326-4ea1-a337-0653d328cbb5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:49.395920 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ba3203a7-1326-4ea1-a337-0653d328cbb5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:49.395920 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ba3203a7-1326-4ea1-a337-0653d328cbb5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:49.396927 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=83 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:17:49.540479 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ba3203a7-1326-4ea1-a337-0653d328cbb5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:49.548061 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-ba3203a7-1326-4ea1-a337-0653d328cbb5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1521 microversion: 2.1 time: 0.167463 Aug 09 18:17:49.548630 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 147/283] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:49 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:49.862588 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f43d835a-b43e-409e-b98f-79195aeb4b93 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:49.863229 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f43d835a-b43e-409e-b98f-79195aeb4b93 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:49.869953 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f43d835a-b43e-409e-b98f-79195aeb4b93 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:49.870650 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f43d835a-b43e-409e-b98f-79195aeb4b93 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:49.871119 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f43d835a-b43e-409e-b98f-79195aeb4b93 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:49.871898 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f43d835a-b43e-409e-b98f-79195aeb4b93 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:49.872340 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f43d835a-b43e-409e-b98f-79195aeb4b93 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:49.872765 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f43d835a-b43e-409e-b98f-79195aeb4b93 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:49.940698 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f43d835a-b43e-409e-b98f-79195aeb4b93 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:49.948165 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f43d835a-b43e-409e-b98f-79195aeb4b93 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1290 microversion: 2.1 time: 0.090919 Aug 09 18:17:49.954870 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 137/284] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:49 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1290 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:50.569711 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b7b84106-aa83-4f40-b778-9e7430c40ef5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:50.570314 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-b7b84106-aa83-4f40-b778-9e7430c40ef5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:50.576535 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b7b84106-aa83-4f40-b778-9e7430c40ef5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:50.577196 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b7b84106-aa83-4f40-b778-9e7430c40ef5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:50.578439 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b7b84106-aa83-4f40-b778-9e7430c40ef5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:50.579378 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b7b84106-aa83-4f40-b778-9e7430c40ef5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:50.579987 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b7b84106-aa83-4f40-b778-9e7430c40ef5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:50.580566 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b7b84106-aa83-4f40-b778-9e7430c40ef5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:50.768631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b7b84106-aa83-4f40-b778-9e7430c40ef5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:50.777940 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b7b84106-aa83-4f40-b778-9e7430c40ef5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1501 microversion: 2.1 time: 0.211994 Aug 09 18:17:50.778514 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 148/285] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:50 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1501 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:50.801160 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-ba10a99a-2c73-45a7-a654-9e627e7aad95 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:50.803274 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-ba10a99a-2c73-45a7-a654-9e627e7aad95 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:50.809464 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ba10a99a-2c73-45a7-a654-9e627e7aad95 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:50.809974 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ba10a99a-2c73-45a7-a654-9e627e7aad95 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:50.810404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ba10a99a-2c73-45a7-a654-9e627e7aad95 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:50.811143 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ba10a99a-2c73-45a7-a654-9e627e7aad95 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:50.811615 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ba10a99a-2c73-45a7-a654-9e627e7aad95 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:50.812918 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ba10a99a-2c73-45a7-a654-9e627e7aad95 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:50.968197 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-472fa465-b933-4865-94be-95a7cc4bf216 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:50.969063 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-472fa465-b933-4865-94be-95a7cc4bf216 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:50.976132 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-472fa465-b933-4865-94be-95a7cc4bf216 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:50.976850 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-472fa465-b933-4865-94be-95a7cc4bf216 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:50.996683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-472fa465-b933-4865-94be-95a7cc4bf216 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:50.996683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-472fa465-b933-4865-94be-95a7cc4bf216 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:50.996683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-472fa465-b933-4865-94be-95a7cc4bf216 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:50.996683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-472fa465-b933-4865-94be-95a7cc4bf216 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:51.020555 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-ba10a99a-2c73-45a7-a654-9e627e7aad95 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:51.029843 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-ba10a99a-2c73-45a7-a654-9e627e7aad95 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1514 microversion: 2.1 time: 0.233301 Aug 09 18:17:51.030424 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 138/286] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:50 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:51.071911 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-472fa465-b933-4865-94be-95a7cc4bf216 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:51.080860 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-472fa465-b933-4865-94be-95a7cc4bf216 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1296 microversion: 2.1 time: 0.116538 Aug 09 18:17:51.081625 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 149/287] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:50 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1296 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:52.102064 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-9d67d438-58f7-42f3-b1cb-a73bf2627b84 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:52.108263 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-9d67d438-58f7-42f3-b1cb-a73bf2627b84 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:52.116773 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9d67d438-58f7-42f3-b1cb-a73bf2627b84 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:52.117252 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9d67d438-58f7-42f3-b1cb-a73bf2627b84 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:52.118140 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9d67d438-58f7-42f3-b1cb-a73bf2627b84 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:52.119027 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9d67d438-58f7-42f3-b1cb-a73bf2627b84 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:52.119657 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9d67d438-58f7-42f3-b1cb-a73bf2627b84 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:52.120243 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9d67d438-58f7-42f3-b1cb-a73bf2627b84 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:52.333069 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-9d67d438-58f7-42f3-b1cb-a73bf2627b84 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:52.340478 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-9d67d438-58f7-42f3-b1cb-a73bf2627b84 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1364 microversion: 2.1 time: 0.242896 Aug 09 18:17:52.341039 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 139/288] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:52 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:52.793183 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-5ffc3781-1102-4bed-be28-121f464b9159 req-8fafcfdf-41f7-4de1-88c7-1cdbb45642f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9924434-5f51-4c4e-8355-93e69db65d9e", "tag": "a5799cfc-e895-4daf-b395-46bd62d8b616"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:17:52.803920 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-5ffc3781-1102-4bed-be28-121f464b9159 req-8fafcfdf-41f7-4de1-88c7-1cdbb45642f6 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:52.804528 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-5ffc3781-1102-4bed-be28-121f464b9159 req-8fafcfdf-41f7-4de1-88c7-1cdbb45642f6 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:52.804962 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-5ffc3781-1102-4bed-be28-121f464b9159 req-8fafcfdf-41f7-4de1-88c7-1cdbb45642f6 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:52.816068 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-5ffc3781-1102-4bed-be28-121f464b9159 req-8fafcfdf-41f7-4de1-88c7-1cdbb45642f6 service nova] Creating event network-changed:a5799cfc-e895-4daf-b395-46bd62d8b616 for instance e9924434-5f51-4c4e-8355-93e69db65d9e on hv-cinder-79797 Aug 09 18:17:52.820997 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-5ffc3781-1102-4bed-be28-121f464b9159 req-8fafcfdf-41f7-4de1-88c7-1cdbb45642f6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032320 Aug 09 18:17:52.821923 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 150/289] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:17:53.370907 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f77348ec-ec75-496a-ac19-5884348b6249 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:53.372226 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f77348ec-ec75-496a-ac19-5884348b6249 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:53.380605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f77348ec-ec75-496a-ac19-5884348b6249 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:53.381177 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f77348ec-ec75-496a-ac19-5884348b6249 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:53.381745 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f77348ec-ec75-496a-ac19-5884348b6249 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:53.382734 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f77348ec-ec75-496a-ac19-5884348b6249 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:53.383443 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f77348ec-ec75-496a-ac19-5884348b6249 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:53.383938 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f77348ec-ec75-496a-ac19-5884348b6249 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:53.595373 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f77348ec-ec75-496a-ac19-5884348b6249 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:53.604181 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f77348ec-ec75-496a-ac19-5884348b6249 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1364 microversion: 2.1 time: 0.237146 Aug 09 18:17:53.604764 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 140/290] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:53 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:54.068689 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-cf2ef9f9-0d91-4e8a-accb-4c118663ccd6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:17:54.070979 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-cf2ef9f9-0d91-4e8a-accb-4c118663ccd6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:54.076991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cf2ef9f9-0d91-4e8a-accb-4c118663ccd6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:54.077477 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cf2ef9f9-0d91-4e8a-accb-4c118663ccd6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:54.077917 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cf2ef9f9-0d91-4e8a-accb-4c118663ccd6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:54.079163 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cf2ef9f9-0d91-4e8a-accb-4c118663ccd6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:54.079915 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cf2ef9f9-0d91-4e8a-accb-4c118663ccd6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:54.080342 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cf2ef9f9-0d91-4e8a-accb-4c118663ccd6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:54.104500 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.objects.instance [None req-cf2ef9f9-0d91-4e8a-accb-4c118663ccd6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lazy-loading 'flavor' on Instance uuid 55a70796-1659-4326-8c40-f33454bc848c {{(pid=118313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:17:54.435868 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-cf2ef9f9-0d91-4e8a-accb-4c118663ccd6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "POST /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c/action" status: 200 len: 32 microversion: 2.1 time: 0.371403 Aug 09 18:17:54.436515 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 151/291] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Aug 9 18:17:54 2022] POST /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c/action => generated 32 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 18:17:54.446734 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-7ea41633-95d4-4f02-8a15-f68f0626985d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:54.447362 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-7ea41633-95d4-4f02-8a15-f68f0626985d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:54.457684 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7ea41633-95d4-4f02-8a15-f68f0626985d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:54.458188 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7ea41633-95d4-4f02-8a15-f68f0626985d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:54.458858 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7ea41633-95d4-4f02-8a15-f68f0626985d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:54.459834 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7ea41633-95d4-4f02-8a15-f68f0626985d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:54.460295 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7ea41633-95d4-4f02-8a15-f68f0626985d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:54.460890 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7ea41633-95d4-4f02-8a15-f68f0626985d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:54.480111 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=100 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:17:54.601101 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-7ea41633-95d4-4f02-8a15-f68f0626985d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:54.609962 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-7ea41633-95d4-4f02-8a15-f68f0626985d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.166666 Aug 09 18:17:54.610559 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 141/292] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:54 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:54.630905 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6ba1862c-a849-4c19-83fe-03aec0c77ee1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:54.631609 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-6ba1862c-a849-4c19-83fe-03aec0c77ee1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:54.638279 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6ba1862c-a849-4c19-83fe-03aec0c77ee1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:54.638983 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6ba1862c-a849-4c19-83fe-03aec0c77ee1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:54.639477 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6ba1862c-a849-4c19-83fe-03aec0c77ee1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:54.640498 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6ba1862c-a849-4c19-83fe-03aec0c77ee1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:54.641044 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6ba1862c-a849-4c19-83fe-03aec0c77ee1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:54.641997 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6ba1862c-a849-4c19-83fe-03aec0c77ee1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:54.778388 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6ba1862c-a849-4c19-83fe-03aec0c77ee1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:54.786404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-6ba1862c-a849-4c19-83fe-03aec0c77ee1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1364 microversion: 2.1 time: 0.159622 Aug 09 18:17:54.787009 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 152/293] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:54 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:55.630975 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e7160c4a-15ee-4636-b503-bc110f74d97b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:55.631576 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e7160c4a-15ee-4636-b503-bc110f74d97b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:55.637736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7160c4a-15ee-4636-b503-bc110f74d97b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:55.638216 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7160c4a-15ee-4636-b503-bc110f74d97b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:55.638647 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7160c4a-15ee-4636-b503-bc110f74d97b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:55.639349 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7160c4a-15ee-4636-b503-bc110f74d97b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:55.639798 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7160c4a-15ee-4636-b503-bc110f74d97b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:55.640220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7160c4a-15ee-4636-b503-bc110f74d97b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:55.778607 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e7160c4a-15ee-4636-b503-bc110f74d97b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:55.786834 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e7160c4a-15ee-4636-b503-bc110f74d97b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.159818 Aug 09 18:17:55.787445 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 142/294] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:55 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:55.806497 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9673668a-1115-4b8b-b3cd-665ce23e4b66 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:55.807580 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9673668a-1115-4b8b-b3cd-665ce23e4b66 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:55.813091 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9673668a-1115-4b8b-b3cd-665ce23e4b66 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:55.813647 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9673668a-1115-4b8b-b3cd-665ce23e4b66 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:55.814096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9673668a-1115-4b8b-b3cd-665ce23e4b66 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:55.814821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9673668a-1115-4b8b-b3cd-665ce23e4b66 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:55.815282 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9673668a-1115-4b8b-b3cd-665ce23e4b66 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:55.815708 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9673668a-1115-4b8b-b3cd-665ce23e4b66 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:55.950338 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9673668a-1115-4b8b-b3cd-665ce23e4b66 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:55.958673 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9673668a-1115-4b8b-b3cd-665ce23e4b66 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1364 microversion: 2.1 time: 0.156107 Aug 09 18:17:55.959253 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 153/295] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:55 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:56.808437 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-cbc651be-40d7-4c5e-bed4-554c2c402566 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:56.809119 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-cbc651be-40d7-4c5e-bed4-554c2c402566 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:56.815573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cbc651be-40d7-4c5e-bed4-554c2c402566 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:56.816058 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cbc651be-40d7-4c5e-bed4-554c2c402566 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:56.816484 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cbc651be-40d7-4c5e-bed4-554c2c402566 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:56.817167 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cbc651be-40d7-4c5e-bed4-554c2c402566 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:56.817617 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cbc651be-40d7-4c5e-bed4-554c2c402566 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:56.818033 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cbc651be-40d7-4c5e-bed4-554c2c402566 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:56.952003 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-cbc651be-40d7-4c5e-bed4-554c2c402566 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:56.959422 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-cbc651be-40d7-4c5e-bed4-554c2c402566 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.154827 Aug 09 18:17:56.959988 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 143/296] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:56 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:56.979408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-406c7e6a-5b0c-41d6-99c7-472a9a36d085 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:56.980013 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-406c7e6a-5b0c-41d6-99c7-472a9a36d085 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:56.982065 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=2 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:17:56.986856 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=10 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:17:56.988812 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-406c7e6a-5b0c-41d6-99c7-472a9a36d085 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:56.989299 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-406c7e6a-5b0c-41d6-99c7-472a9a36d085 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:56.989731 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-406c7e6a-5b0c-41d6-99c7-472a9a36d085 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:56.990417 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-406c7e6a-5b0c-41d6-99c7-472a9a36d085 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:56.990898 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-406c7e6a-5b0c-41d6-99c7-472a9a36d085 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:56.991317 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-406c7e6a-5b0c-41d6-99c7-472a9a36d085 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:57.123321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-406c7e6a-5b0c-41d6-99c7-472a9a36d085 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:57.131436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-406c7e6a-5b0c-41d6-99c7-472a9a36d085 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1364 microversion: 2.1 time: 0.156304 Aug 09 18:17:57.131991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 154/297] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:56 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:57.981062 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-80b07724-f789-4764-941c-1b884220e070 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:57.981677 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-80b07724-f789-4764-941c-1b884220e070 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:57.984093 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=4 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:17:57.989765 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-80b07724-f789-4764-941c-1b884220e070 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:57.990253 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-80b07724-f789-4764-941c-1b884220e070 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:57.990692 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-80b07724-f789-4764-941c-1b884220e070 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:57.991414 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-80b07724-f789-4764-941c-1b884220e070 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:57.991872 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-80b07724-f789-4764-941c-1b884220e070 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:57.992294 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-80b07724-f789-4764-941c-1b884220e070 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:58.131137 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-80b07724-f789-4764-941c-1b884220e070 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:58.138553 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-80b07724-f789-4764-941c-1b884220e070 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.161538 Aug 09 18:17:58.139230 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 144/298] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:57 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:58.157939 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5c214a85-32f6-4193-b8ea-d457a69936d9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:58.157939 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-5c214a85-32f6-4193-b8ea-d457a69936d9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:58.162039 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5c214a85-32f6-4193-b8ea-d457a69936d9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:58.162721 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5c214a85-32f6-4193-b8ea-d457a69936d9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:58.163329 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5c214a85-32f6-4193-b8ea-d457a69936d9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:58.164133 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5c214a85-32f6-4193-b8ea-d457a69936d9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:58.164671 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5c214a85-32f6-4193-b8ea-d457a69936d9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:58.165166 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5c214a85-32f6-4193-b8ea-d457a69936d9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:58.300155 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-5c214a85-32f6-4193-b8ea-d457a69936d9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:58.307829 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-5c214a85-32f6-4193-b8ea-d457a69936d9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1364 microversion: 2.1 time: 0.158325 Aug 09 18:17:58.308402 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 155/299] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:58 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:59.163635 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d2888a66-4ffc-47af-9c44-cb2478b0aa8e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:59.164255 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d2888a66-4ffc-47af-9c44-cb2478b0aa8e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:59.171076 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d2888a66-4ffc-47af-9c44-cb2478b0aa8e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:59.171576 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d2888a66-4ffc-47af-9c44-cb2478b0aa8e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:59.172030 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d2888a66-4ffc-47af-9c44-cb2478b0aa8e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:59.173481 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d2888a66-4ffc-47af-9c44-cb2478b0aa8e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:59.174139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d2888a66-4ffc-47af-9c44-cb2478b0aa8e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:59.174573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d2888a66-4ffc-47af-9c44-cb2478b0aa8e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:59.333620 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-472567be-1e4a-44bd-bfbc-9d4631e3f776 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:59.334060 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-472567be-1e4a-44bd-bfbc-9d4631e3f776 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:59.337042 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d2888a66-4ffc-47af-9c44-cb2478b0aa8e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:59.340804 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-472567be-1e4a-44bd-bfbc-9d4631e3f776 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:59.341440 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-472567be-1e4a-44bd-bfbc-9d4631e3f776 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:59.342154 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-472567be-1e4a-44bd-bfbc-9d4631e3f776 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:59.343051 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-472567be-1e4a-44bd-bfbc-9d4631e3f776 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:59.343548 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-472567be-1e4a-44bd-bfbc-9d4631e3f776 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:59.344371 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-472567be-1e4a-44bd-bfbc-9d4631e3f776 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:59.346970 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d2888a66-4ffc-47af-9c44-cb2478b0aa8e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.190228 Aug 09 18:17:59.359955 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 145/300] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:59 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:59.504530 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-472567be-1e4a-44bd-bfbc-9d4631e3f776 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:59.511800 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-472567be-1e4a-44bd-bfbc-9d4631e3f776 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1364 microversion: 2.1 time: 0.183550 Aug 09 18:17:59.512360 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 156/301] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:59 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:00.369649 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-9f420f4b-b76a-4e0c-848c-80facd242535 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:00.370255 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-9f420f4b-b76a-4e0c-848c-80facd242535 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:00.376665 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f420f4b-b76a-4e0c-848c-80facd242535 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:00.377939 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f420f4b-b76a-4e0c-848c-80facd242535 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:00.378361 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f420f4b-b76a-4e0c-848c-80facd242535 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:00.379073 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f420f4b-b76a-4e0c-848c-80facd242535 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:00.379529 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f420f4b-b76a-4e0c-848c-80facd242535 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:00.379948 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f420f4b-b76a-4e0c-848c-80facd242535 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:00.533308 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-9f420f4b-b76a-4e0c-848c-80facd242535 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:00.534155 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-4415df3a-d33e-4d91-8798-2d5d4cf58a11 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:00.534878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-4415df3a-d33e-4d91-8798-2d5d4cf58a11 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:00.540888 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4415df3a-d33e-4d91-8798-2d5d4cf58a11 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:00.541529 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-9f420f4b-b76a-4e0c-848c-80facd242535 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.175847 Aug 09 18:18:00.541661 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4415df3a-d33e-4d91-8798-2d5d4cf58a11 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:00.542164 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4415df3a-d33e-4d91-8798-2d5d4cf58a11 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:00.542293 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 146/302] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:00 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:00.543028 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4415df3a-d33e-4d91-8798-2d5d4cf58a11 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:00.543551 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4415df3a-d33e-4d91-8798-2d5d4cf58a11 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:00.544077 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4415df3a-d33e-4d91-8798-2d5d4cf58a11 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:00.695038 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4415df3a-d33e-4d91-8798-2d5d4cf58a11 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:00.703220 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-4415df3a-d33e-4d91-8798-2d5d4cf58a11 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1364 microversion: 2.1 time: 0.173351 Aug 09 18:18:00.703882 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 157/303] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:00 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:00.891437 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-cd677dea-d427-4e22-a67a-0d689ab8c940 req-a46021f1-efa8-425b-9a73-d61c023167dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9924434-5f51-4c4e-8355-93e69db65d9e", "name": "network-vif-plugged", "status": "completed", "tag": "a5799cfc-e895-4daf-b395-46bd62d8b616"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:18:00.901691 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-cd677dea-d427-4e22-a67a-0d689ab8c940 req-a46021f1-efa8-425b-9a73-d61c023167dd service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:00.902419 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-cd677dea-d427-4e22-a67a-0d689ab8c940 req-a46021f1-efa8-425b-9a73-d61c023167dd service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:00.902876 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-cd677dea-d427-4e22-a67a-0d689ab8c940 req-a46021f1-efa8-425b-9a73-d61c023167dd service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:00.915720 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-cd677dea-d427-4e22-a67a-0d689ab8c940 req-a46021f1-efa8-425b-9a73-d61c023167dd service nova] Creating event network-vif-plugged:a5799cfc-e895-4daf-b395-46bd62d8b616 for instance e9924434-5f51-4c4e-8355-93e69db65d9e on hv-cinder-79797 Aug 09 18:18:00.920720 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-cd677dea-d427-4e22-a67a-0d689ab8c940 req-a46021f1-efa8-425b-9a73-d61c023167dd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033725 Aug 09 18:18:00.921345 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 147/304] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:18:01.563207 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2649f94a-2dac-44dc-a524-5333ec71593e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:01.563892 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-2649f94a-2dac-44dc-a524-5333ec71593e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:01.570165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2649f94a-2dac-44dc-a524-5333ec71593e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:01.570657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2649f94a-2dac-44dc-a524-5333ec71593e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:01.571146 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2649f94a-2dac-44dc-a524-5333ec71593e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:01.571998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2649f94a-2dac-44dc-a524-5333ec71593e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:01.572675 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2649f94a-2dac-44dc-a524-5333ec71593e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:01.573164 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2649f94a-2dac-44dc-a524-5333ec71593e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:01.726648 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f3368c75-81f3-4fe9-b0c5-c438dbfc679d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:01.727605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f3368c75-81f3-4fe9-b0c5-c438dbfc679d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:01.736328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f3368c75-81f3-4fe9-b0c5-c438dbfc679d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:01.751255 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f3368c75-81f3-4fe9-b0c5-c438dbfc679d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:01.751255 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f3368c75-81f3-4fe9-b0c5-c438dbfc679d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:01.751255 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f3368c75-81f3-4fe9-b0c5-c438dbfc679d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:01.751255 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f3368c75-81f3-4fe9-b0c5-c438dbfc679d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:01.754462 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f3368c75-81f3-4fe9-b0c5-c438dbfc679d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:01.944024 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-2649f94a-2dac-44dc-a524-5333ec71593e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:01.950941 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f3368c75-81f3-4fe9-b0c5-c438dbfc679d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:01.951540 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-2649f94a-2dac-44dc-a524-5333ec71593e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.392342 Aug 09 18:18:01.952121 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 158/305] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:01 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:01.958822 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f3368c75-81f3-4fe9-b0c5-c438dbfc679d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1364 microversion: 2.1 time: 0.237980 Aug 09 18:18:01.959385 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 148/306] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:01 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1364 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:02.972782 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-3b88683f-2468-4e3b-975d-6eafc3f59e06 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:02.973764 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-3b88683f-2468-4e3b-975d-6eafc3f59e06 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:02.979669 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-1c8e69b9-dd56-4c57-9ec3-d0dc2a0c3b54 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:02.980859 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3b88683f-2468-4e3b-975d-6eafc3f59e06 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:02.980991 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-1c8e69b9-dd56-4c57-9ec3-d0dc2a0c3b54 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:02.981448 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3b88683f-2468-4e3b-975d-6eafc3f59e06 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:02.981870 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3b88683f-2468-4e3b-975d-6eafc3f59e06 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:02.982738 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3b88683f-2468-4e3b-975d-6eafc3f59e06 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:02.983226 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3b88683f-2468-4e3b-975d-6eafc3f59e06 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:02.983793 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3b88683f-2468-4e3b-975d-6eafc3f59e06 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:02.988576 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1c8e69b9-dd56-4c57-9ec3-d0dc2a0c3b54 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:02.989083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1c8e69b9-dd56-4c57-9ec3-d0dc2a0c3b54 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:02.989522 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1c8e69b9-dd56-4c57-9ec3-d0dc2a0c3b54 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:02.990217 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1c8e69b9-dd56-4c57-9ec3-d0dc2a0c3b54 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:02.991075 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1c8e69b9-dd56-4c57-9ec3-d0dc2a0c3b54 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:02.991508 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1c8e69b9-dd56-4c57-9ec3-d0dc2a0c3b54 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:03.190798 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-3b88683f-2468-4e3b-975d-6eafc3f59e06 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:03.195268 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-1c8e69b9-dd56-4c57-9ec3-d0dc2a0c3b54 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:03.199054 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-3b88683f-2468-4e3b-975d-6eafc3f59e06 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.230188 Aug 09 18:18:03.199613 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 159/307] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:02 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:03.202978 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-1c8e69b9-dd56-4c57-9ec3-d0dc2a0c3b54 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1364 microversion: 2.1 time: 0.227139 Aug 09 18:18:03.203530 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 149/308] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:02 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:04.223074 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-3f8f2118-133a-4f18-982b-70acf271fcb2 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:04.223667 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b4383ab2-00a1-48bd-9eb5-967ccbfbdfa9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:04.224074 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-3f8f2118-133a-4f18-982b-70acf271fcb2 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:04.224266 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-b4383ab2-00a1-48bd-9eb5-967ccbfbdfa9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:04.230633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3f8f2118-133a-4f18-982b-70acf271fcb2 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:04.230898 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b4383ab2-00a1-48bd-9eb5-967ccbfbdfa9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:04.231385 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3f8f2118-133a-4f18-982b-70acf271fcb2 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:04.231545 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b4383ab2-00a1-48bd-9eb5-967ccbfbdfa9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:04.231682 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3f8f2118-133a-4f18-982b-70acf271fcb2 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:04.231795 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b4383ab2-00a1-48bd-9eb5-967ccbfbdfa9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:04.232256 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3f8f2118-133a-4f18-982b-70acf271fcb2 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:04.232620 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b4383ab2-00a1-48bd-9eb5-967ccbfbdfa9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:04.232909 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3f8f2118-133a-4f18-982b-70acf271fcb2 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:04.233136 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b4383ab2-00a1-48bd-9eb5-967ccbfbdfa9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:04.233344 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3f8f2118-133a-4f18-982b-70acf271fcb2 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:04.233546 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b4383ab2-00a1-48bd-9eb5-967ccbfbdfa9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:04.457923 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b4383ab2-00a1-48bd-9eb5-967ccbfbdfa9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:04.471261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-3f8f2118-133a-4f18-982b-70acf271fcb2 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:04.481618 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-3f8f2118-133a-4f18-982b-70acf271fcb2 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1550 microversion: 2.1 time: 0.262539 Aug 09 18:18:04.486268 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 150/309] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:04 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1550 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:04.486399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b4383ab2-00a1-48bd-9eb5-967ccbfbdfa9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.267355 Aug 09 18:18:04.486399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 160/310] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:04 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:04.506981 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e3aa5e40-db7e-4693-94f8-23748a3256d5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:04.507478 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e3aa5e40-db7e-4693-94f8-23748a3256d5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:04.513414 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3aa5e40-db7e-4693-94f8-23748a3256d5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:04.513905 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3aa5e40-db7e-4693-94f8-23748a3256d5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:04.514349 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3aa5e40-db7e-4693-94f8-23748a3256d5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:04.515117 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3aa5e40-db7e-4693-94f8-23748a3256d5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:04.515570 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3aa5e40-db7e-4693-94f8-23748a3256d5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:04.515993 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3aa5e40-db7e-4693-94f8-23748a3256d5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:04.601193 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e3aa5e40-db7e-4693-94f8-23748a3256d5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099187 Aug 09 18:18:04.601783 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 151/311] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Aug 9 18:18:04 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:18:05.506991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9ef224e7-653e-4e72-b69c-15083576cd0f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:05.507866 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9ef224e7-653e-4e72-b69c-15083576cd0f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:05.514015 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9ef224e7-653e-4e72-b69c-15083576cd0f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:05.514616 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9ef224e7-653e-4e72-b69c-15083576cd0f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:05.515123 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9ef224e7-653e-4e72-b69c-15083576cd0f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:05.515881 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9ef224e7-653e-4e72-b69c-15083576cd0f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:05.516452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9ef224e7-653e-4e72-b69c-15083576cd0f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:05.516931 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9ef224e7-653e-4e72-b69c-15083576cd0f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:05.653132 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9ef224e7-653e-4e72-b69c-15083576cd0f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:05.660582 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9ef224e7-653e-4e72-b69c-15083576cd0f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.157777 Aug 09 18:18:05.661150 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 161/312] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:05 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:06.142658 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-54b1fa0c-d43c-4d33-8e1f-1bb5579625e7 req-cfa133ae-8d37-4ec0-b283-d7a935bafc17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9924434-5f51-4c4e-8355-93e69db65d9e", "tag": "a5799cfc-e895-4daf-b395-46bd62d8b616"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:18:06.152910 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-54b1fa0c-d43c-4d33-8e1f-1bb5579625e7 req-cfa133ae-8d37-4ec0-b283-d7a935bafc17 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:06.153381 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-54b1fa0c-d43c-4d33-8e1f-1bb5579625e7 req-cfa133ae-8d37-4ec0-b283-d7a935bafc17 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:06.153807 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-54b1fa0c-d43c-4d33-8e1f-1bb5579625e7 req-cfa133ae-8d37-4ec0-b283-d7a935bafc17 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:06.165780 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-54b1fa0c-d43c-4d33-8e1f-1bb5579625e7 req-cfa133ae-8d37-4ec0-b283-d7a935bafc17 service nova] Creating event network-changed:a5799cfc-e895-4daf-b395-46bd62d8b616 for instance e9924434-5f51-4c4e-8355-93e69db65d9e on hv-cinder-79797 Aug 09 18:18:06.171363 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-54b1fa0c-d43c-4d33-8e1f-1bb5579625e7 req-cfa133ae-8d37-4ec0-b283-d7a935bafc17 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032645 Aug 09 18:18:06.172064 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 152/313] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:18:06.681511 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-34cb31f2-1923-4592-8811-8c2e0f6511ba tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:06.682540 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-34cb31f2-1923-4592-8811-8c2e0f6511ba tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:06.689006 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-34cb31f2-1923-4592-8811-8c2e0f6511ba tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:06.689615 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-34cb31f2-1923-4592-8811-8c2e0f6511ba tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:06.690174 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-34cb31f2-1923-4592-8811-8c2e0f6511ba tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:06.691672 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-34cb31f2-1923-4592-8811-8c2e0f6511ba tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:06.692227 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-34cb31f2-1923-4592-8811-8c2e0f6511ba tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:06.692752 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-34cb31f2-1923-4592-8811-8c2e0f6511ba tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:06.709925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:18:06.861121 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-34cb31f2-1923-4592-8811-8c2e0f6511ba tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:06.869398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-34cb31f2-1923-4592-8811-8c2e0f6511ba tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.191831 Aug 09 18:18:06.869963 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 162/314] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:06 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:07.893412 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-462b2d6f-a731-42c1-b2df-ae47dab644ac tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:07.897463 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-462b2d6f-a731-42c1-b2df-ae47dab644ac tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:07.897463 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=56 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:18:07.902046 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-462b2d6f-a731-42c1-b2df-ae47dab644ac tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:07.902560 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-462b2d6f-a731-42c1-b2df-ae47dab644ac tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:07.903067 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-462b2d6f-a731-42c1-b2df-ae47dab644ac tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:07.903807 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-462b2d6f-a731-42c1-b2df-ae47dab644ac tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:07.904267 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-462b2d6f-a731-42c1-b2df-ae47dab644ac tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:07.904695 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-462b2d6f-a731-42c1-b2df-ae47dab644ac tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:08.037221 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-462b2d6f-a731-42c1-b2df-ae47dab644ac tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:08.045255 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-462b2d6f-a731-42c1-b2df-ae47dab644ac tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.156161 Aug 09 18:18:08.046038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 153/315] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:07 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:09.066827 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d278635f-3317-40d6-8a54-70a965dd463b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:09.067374 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d278635f-3317-40d6-8a54-70a965dd463b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:09.069647 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:18:09.074530 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d278635f-3317-40d6-8a54-70a965dd463b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:09.075051 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d278635f-3317-40d6-8a54-70a965dd463b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:09.075484 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d278635f-3317-40d6-8a54-70a965dd463b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:09.076201 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d278635f-3317-40d6-8a54-70a965dd463b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:09.076700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d278635f-3317-40d6-8a54-70a965dd463b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:09.077126 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d278635f-3317-40d6-8a54-70a965dd463b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:09.208774 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d278635f-3317-40d6-8a54-70a965dd463b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:09.216320 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d278635f-3317-40d6-8a54-70a965dd463b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.153414 Aug 09 18:18:09.216887 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 163/316] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:09 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:10.236996 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e361b30b-71dd-455f-84ee-e02d573f208f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:10.237607 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e361b30b-71dd-455f-84ee-e02d573f208f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:10.244194 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e361b30b-71dd-455f-84ee-e02d573f208f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:10.244714 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e361b30b-71dd-455f-84ee-e02d573f208f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:10.245150 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e361b30b-71dd-455f-84ee-e02d573f208f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:10.245834 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e361b30b-71dd-455f-84ee-e02d573f208f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:10.246301 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e361b30b-71dd-455f-84ee-e02d573f208f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:10.246730 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e361b30b-71dd-455f-84ee-e02d573f208f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:10.381592 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e361b30b-71dd-455f-84ee-e02d573f208f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:10.389052 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e361b30b-71dd-455f-84ee-e02d573f208f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.156501 Aug 09 18:18:10.389615 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 154/317] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:10 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:11.412464 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-33ebd90d-7d6c-4cce-a6b7-edc80bd48d78 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:11.416431 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-33ebd90d-7d6c-4cce-a6b7-edc80bd48d78 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:11.419497 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-33ebd90d-7d6c-4cce-a6b7-edc80bd48d78 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:11.419976 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-33ebd90d-7d6c-4cce-a6b7-edc80bd48d78 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:11.420404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-33ebd90d-7d6c-4cce-a6b7-edc80bd48d78 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:11.421090 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-33ebd90d-7d6c-4cce-a6b7-edc80bd48d78 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:11.421540 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-33ebd90d-7d6c-4cce-a6b7-edc80bd48d78 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:11.421960 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-33ebd90d-7d6c-4cce-a6b7-edc80bd48d78 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:11.555040 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-33ebd90d-7d6c-4cce-a6b7-edc80bd48d78 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:11.562645 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-33ebd90d-7d6c-4cce-a6b7-edc80bd48d78 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.155057 Aug 09 18:18:11.563234 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 164/318] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:11 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:12.583873 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-cc24dd3f-f624-496b-8422-465314c5c1ac tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:12.584478 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-cc24dd3f-f624-496b-8422-465314c5c1ac tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:12.590993 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cc24dd3f-f624-496b-8422-465314c5c1ac tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:12.591474 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cc24dd3f-f624-496b-8422-465314c5c1ac tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:12.591906 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cc24dd3f-f624-496b-8422-465314c5c1ac tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:12.592586 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cc24dd3f-f624-496b-8422-465314c5c1ac tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:12.593034 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cc24dd3f-f624-496b-8422-465314c5c1ac tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:12.593531 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cc24dd3f-f624-496b-8422-465314c5c1ac tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:12.727265 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-cc24dd3f-f624-496b-8422-465314c5c1ac tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:12.735892 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-cc24dd3f-f624-496b-8422-465314c5c1ac tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.155979 Aug 09 18:18:12.736453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 155/319] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:12 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:13.758188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a0daab6f-ebc9-43d8-b66b-c38c3cb0a4a8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:13.758813 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a0daab6f-ebc9-43d8-b66b-c38c3cb0a4a8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:13.764661 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a0daab6f-ebc9-43d8-b66b-c38c3cb0a4a8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:13.765140 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a0daab6f-ebc9-43d8-b66b-c38c3cb0a4a8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:13.765572 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a0daab6f-ebc9-43d8-b66b-c38c3cb0a4a8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:13.766286 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a0daab6f-ebc9-43d8-b66b-c38c3cb0a4a8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:13.766772 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a0daab6f-ebc9-43d8-b66b-c38c3cb0a4a8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:13.767204 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a0daab6f-ebc9-43d8-b66b-c38c3cb0a4a8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:13.895380 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a0daab6f-ebc9-43d8-b66b-c38c3cb0a4a8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:13.902654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a0daab6f-ebc9-43d8-b66b-c38c3cb0a4a8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.149130 Aug 09 18:18:13.903229 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 165/320] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:13 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:14.924134 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-a9fada29-556a-4b3a-a645-853e588491aa tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:14.924741 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-a9fada29-556a-4b3a-a645-853e588491aa tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:14.931300 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a9fada29-556a-4b3a-a645-853e588491aa tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:14.931786 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a9fada29-556a-4b3a-a645-853e588491aa tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:14.932216 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a9fada29-556a-4b3a-a645-853e588491aa tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:14.932926 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a9fada29-556a-4b3a-a645-853e588491aa tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:14.933576 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a9fada29-556a-4b3a-a645-853e588491aa tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:14.934000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a9fada29-556a-4b3a-a645-853e588491aa tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:15.065683 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a9fada29-556a-4b3a-a645-853e588491aa tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:15.074190 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-a9fada29-556a-4b3a-a645-853e588491aa tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.153952 Aug 09 18:18:15.074761 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 156/321] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:14 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:16.095201 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-93fd47ec-116e-462d-b441-8e80044958d6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:16.095804 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-93fd47ec-116e-462d-b441-8e80044958d6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:16.102692 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-93fd47ec-116e-462d-b441-8e80044958d6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:16.103197 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-93fd47ec-116e-462d-b441-8e80044958d6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:16.103628 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-93fd47ec-116e-462d-b441-8e80044958d6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:16.104317 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-93fd47ec-116e-462d-b441-8e80044958d6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:16.104953 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-93fd47ec-116e-462d-b441-8e80044958d6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:16.105644 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-93fd47ec-116e-462d-b441-8e80044958d6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:16.237383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-93fd47ec-116e-462d-b441-8e80044958d6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:16.245852 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-93fd47ec-116e-462d-b441-8e80044958d6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.154465 Aug 09 18:18:16.246433 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 166/322] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:16 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:17.267347 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e12f7e1e-a910-44aa-88a5-bc81310e804a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:17.267943 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e12f7e1e-a910-44aa-88a5-bc81310e804a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:17.274887 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e12f7e1e-a910-44aa-88a5-bc81310e804a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:17.275368 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e12f7e1e-a910-44aa-88a5-bc81310e804a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:17.275824 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e12f7e1e-a910-44aa-88a5-bc81310e804a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:17.276502 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e12f7e1e-a910-44aa-88a5-bc81310e804a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:17.276948 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e12f7e1e-a910-44aa-88a5-bc81310e804a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:17.277397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e12f7e1e-a910-44aa-88a5-bc81310e804a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:17.406263 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e12f7e1e-a910-44aa-88a5-bc81310e804a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:17.414516 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e12f7e1e-a910-44aa-88a5-bc81310e804a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.150960 Aug 09 18:18:17.415125 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 157/323] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:17 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:18.435829 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-1ccd1a08-f82b-4b91-acaa-c2dd26f895d9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:18.436475 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-1ccd1a08-f82b-4b91-acaa-c2dd26f895d9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:18.443307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1ccd1a08-f82b-4b91-acaa-c2dd26f895d9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:18.443917 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1ccd1a08-f82b-4b91-acaa-c2dd26f895d9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:18.444799 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1ccd1a08-f82b-4b91-acaa-c2dd26f895d9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:18.445694 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1ccd1a08-f82b-4b91-acaa-c2dd26f895d9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:18.460710 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1ccd1a08-f82b-4b91-acaa-c2dd26f895d9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:18.460710 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1ccd1a08-f82b-4b91-acaa-c2dd26f895d9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:18.587817 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-1ccd1a08-f82b-4b91-acaa-c2dd26f895d9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:18.595486 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-1ccd1a08-f82b-4b91-acaa-c2dd26f895d9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.163901 Aug 09 18:18:18.599361 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 167/324] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:18 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:19.619320 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-ef0dcda6-b96a-47b9-836f-d6436fc4d597 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:19.619846 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-ef0dcda6-b96a-47b9-836f-d6436fc4d597 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:19.626456 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ef0dcda6-b96a-47b9-836f-d6436fc4d597 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:19.626977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ef0dcda6-b96a-47b9-836f-d6436fc4d597 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:19.627413 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ef0dcda6-b96a-47b9-836f-d6436fc4d597 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:19.628147 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ef0dcda6-b96a-47b9-836f-d6436fc4d597 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:19.628601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ef0dcda6-b96a-47b9-836f-d6436fc4d597 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:19.629041 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ef0dcda6-b96a-47b9-836f-d6436fc4d597 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:19.765312 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-ef0dcda6-b96a-47b9-836f-d6436fc4d597 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:19.772274 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-ef0dcda6-b96a-47b9-836f-d6436fc4d597 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.157845 Aug 09 18:18:19.772848 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 158/325] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:19 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:20.794252 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-4d89b76a-382b-4e7f-ba02-27c1189f4393 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:20.794885 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-4d89b76a-382b-4e7f-ba02-27c1189f4393 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:20.804882 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d89b76a-382b-4e7f-ba02-27c1189f4393 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:20.804882 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d89b76a-382b-4e7f-ba02-27c1189f4393 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:20.804882 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d89b76a-382b-4e7f-ba02-27c1189f4393 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:20.804882 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d89b76a-382b-4e7f-ba02-27c1189f4393 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:20.805717 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d89b76a-382b-4e7f-ba02-27c1189f4393 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:20.805717 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d89b76a-382b-4e7f-ba02-27c1189f4393 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:20.941250 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4d89b76a-382b-4e7f-ba02-27c1189f4393 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:20.949257 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-4d89b76a-382b-4e7f-ba02-27c1189f4393 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.158896 Aug 09 18:18:20.949826 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 168/326] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:20 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:21.970734 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-7762eec3-b70e-4f50-a7f7-45fa8fcb194c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:21.971343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-7762eec3-b70e-4f50-a7f7-45fa8fcb194c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:21.978943 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7762eec3-b70e-4f50-a7f7-45fa8fcb194c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:21.979434 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7762eec3-b70e-4f50-a7f7-45fa8fcb194c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:21.979869 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7762eec3-b70e-4f50-a7f7-45fa8fcb194c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:21.980608 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7762eec3-b70e-4f50-a7f7-45fa8fcb194c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:21.981066 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7762eec3-b70e-4f50-a7f7-45fa8fcb194c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:21.981488 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7762eec3-b70e-4f50-a7f7-45fa8fcb194c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:22.193271 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-7762eec3-b70e-4f50-a7f7-45fa8fcb194c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:22.196717 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=100 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:18:22.201107 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-7762eec3-b70e-4f50-a7f7-45fa8fcb194c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.234216 Aug 09 18:18:22.210786 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 159/327] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:21 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:23.223199 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-12335a46-86ea-4225-8510-2654c2906fa0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:23.225035 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-12335a46-86ea-4225-8510-2654c2906fa0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:23.235515 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-12335a46-86ea-4225-8510-2654c2906fa0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:23.236131 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-12335a46-86ea-4225-8510-2654c2906fa0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:23.236690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-12335a46-86ea-4225-8510-2654c2906fa0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:23.237819 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-12335a46-86ea-4225-8510-2654c2906fa0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:23.238359 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-12335a46-86ea-4225-8510-2654c2906fa0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:23.238926 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-12335a46-86ea-4225-8510-2654c2906fa0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:23.598433 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-12335a46-86ea-4225-8510-2654c2906fa0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:23.607707 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-12335a46-86ea-4225-8510-2654c2906fa0 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.388251 Aug 09 18:18:23.608293 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 169/328] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:23 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:24.639250 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f2591c92-0046-43ea-97d6-6d4cf2a8e458 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:24.639250 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f2591c92-0046-43ea-97d6-6d4cf2a8e458 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:24.639250 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f2591c92-0046-43ea-97d6-6d4cf2a8e458 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:24.639250 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f2591c92-0046-43ea-97d6-6d4cf2a8e458 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:24.639950 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f2591c92-0046-43ea-97d6-6d4cf2a8e458 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:24.639950 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f2591c92-0046-43ea-97d6-6d4cf2a8e458 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:24.639950 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f2591c92-0046-43ea-97d6-6d4cf2a8e458 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:24.639950 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f2591c92-0046-43ea-97d6-6d4cf2a8e458 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:24.805119 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f2591c92-0046-43ea-97d6-6d4cf2a8e458 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:24.817038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f2591c92-0046-43ea-97d6-6d4cf2a8e458 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.191683 Aug 09 18:18:24.817625 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 160/329] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:24 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:25.843012 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c57550d6-7faf-44ea-8de3-eca89a2d0b2e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:25.844429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-c57550d6-7faf-44ea-8de3-eca89a2d0b2e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:25.856113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c57550d6-7faf-44ea-8de3-eca89a2d0b2e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:25.856982 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c57550d6-7faf-44ea-8de3-eca89a2d0b2e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:25.857774 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c57550d6-7faf-44ea-8de3-eca89a2d0b2e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:25.859047 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c57550d6-7faf-44ea-8de3-eca89a2d0b2e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:25.860164 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c57550d6-7faf-44ea-8de3-eca89a2d0b2e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:25.868702 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c57550d6-7faf-44ea-8de3-eca89a2d0b2e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:26.004073 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-c57550d6-7faf-44ea-8de3-eca89a2d0b2e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:26.012015 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-c57550d6-7faf-44ea-8de3-eca89a2d0b2e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.177271 Aug 09 18:18:26.012599 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 170/330] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:25 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:27.033260 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-11515f6c-222f-416c-9d2d-e8bad243c480 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:27.033876 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-11515f6c-222f-416c-9d2d-e8bad243c480 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:27.041222 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-11515f6c-222f-416c-9d2d-e8bad243c480 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:27.041691 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-11515f6c-222f-416c-9d2d-e8bad243c480 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:27.042081 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-11515f6c-222f-416c-9d2d-e8bad243c480 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:27.042802 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-11515f6c-222f-416c-9d2d-e8bad243c480 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:27.043257 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-11515f6c-222f-416c-9d2d-e8bad243c480 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:27.043681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-11515f6c-222f-416c-9d2d-e8bad243c480 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:27.178078 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-11515f6c-222f-416c-9d2d-e8bad243c480 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:27.187124 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-11515f6c-222f-416c-9d2d-e8bad243c480 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.157241 Aug 09 18:18:27.187627 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 161/331] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:27 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:28.208882 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-657ac852-e129-4820-925f-23815b55aca8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:28.209515 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-657ac852-e129-4820-925f-23815b55aca8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:28.219419 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-657ac852-e129-4820-925f-23815b55aca8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:28.219913 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-657ac852-e129-4820-925f-23815b55aca8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:28.220354 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-657ac852-e129-4820-925f-23815b55aca8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:28.223089 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-657ac852-e129-4820-925f-23815b55aca8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:28.223089 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-657ac852-e129-4820-925f-23815b55aca8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:28.223089 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-657ac852-e129-4820-925f-23815b55aca8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:28.363220 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-657ac852-e129-4820-925f-23815b55aca8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:28.370842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-657ac852-e129-4820-925f-23815b55aca8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.165617 Aug 09 18:18:28.373270 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 171/332] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:28 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:29.393550 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d7d8590e-eaf5-4985-87a6-75466f9804b5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:29.394160 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d7d8590e-eaf5-4985-87a6-75466f9804b5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:29.401149 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d7d8590e-eaf5-4985-87a6-75466f9804b5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:29.401636 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d7d8590e-eaf5-4985-87a6-75466f9804b5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:29.402066 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d7d8590e-eaf5-4985-87a6-75466f9804b5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:29.402774 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d7d8590e-eaf5-4985-87a6-75466f9804b5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:29.403229 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d7d8590e-eaf5-4985-87a6-75466f9804b5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:29.403651 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d7d8590e-eaf5-4985-87a6-75466f9804b5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:29.539794 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d7d8590e-eaf5-4985-87a6-75466f9804b5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:29.548482 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d7d8590e-eaf5-4985-87a6-75466f9804b5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.158921 Aug 09 18:18:29.549062 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 162/333] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:29 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:30.570161 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b5d2b5bc-fc10-4cee-878a-1e016e6bb92f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:30.570826 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-b5d2b5bc-fc10-4cee-878a-1e016e6bb92f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:30.576774 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b5d2b5bc-fc10-4cee-878a-1e016e6bb92f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:30.577261 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b5d2b5bc-fc10-4cee-878a-1e016e6bb92f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:30.577696 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b5d2b5bc-fc10-4cee-878a-1e016e6bb92f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:30.578386 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b5d2b5bc-fc10-4cee-878a-1e016e6bb92f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:30.578873 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b5d2b5bc-fc10-4cee-878a-1e016e6bb92f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:30.579303 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b5d2b5bc-fc10-4cee-878a-1e016e6bb92f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:30.726914 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b5d2b5bc-fc10-4cee-878a-1e016e6bb92f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:30.735382 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b5d2b5bc-fc10-4cee-878a-1e016e6bb92f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1500 microversion: 2.1 time: 0.168663 Aug 09 18:18:30.735950 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 172/334] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:30 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1500 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:30.756504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-a6808047-b31e-4714-bcfc-484a665b173b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d1223aa-dc74-41e0-9639-0a1286a73557"}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:18:30.765600 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-a6808047-b31e-4714-bcfc-484a665b173b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:30.766226 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a6808047-b31e-4714-bcfc-484a665b173b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:30.766305 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a6808047-b31e-4714-bcfc-484a665b173b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:30.766695 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a6808047-b31e-4714-bcfc-484a665b173b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:30.767403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a6808047-b31e-4714-bcfc-484a665b173b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:30.767849 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a6808047-b31e-4714-bcfc-484a665b173b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:30.768267 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a6808047-b31e-4714-bcfc-484a665b173b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:30.792530 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-a6808047-b31e-4714-bcfc-484a665b173b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] HTTP exception thrown: Cannot 'attach_volume' instance 55a70796-1659-4326-8c40-f33454bc848c while it is in vm_state rescued Aug 09 18:18:30.794297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-a6808047-b31e-4714-bcfc-484a665b173b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Request method failure captured: Aug 09 18:18:30.794297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: POST /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c/os-volume_attachments HTTP/1.1 Aug 09 18:18:30.794297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:18:30.794297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:18:30.794297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:18:30.794297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 74 Aug 09 18:18:30.794297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:18:30.794297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:18:30.794297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:18:30.794297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:18:30.794297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qRIOR_EAMdUNpksmgwcf99FOSSqhVI8tsoIxh3BjiMzTfrXpYksm4wl0XX75hcX4zSB7VEWBHIFqhlPU6iolaNft99hftdwd5BJh27Wa4fHll0E3coSOe8qDBsNwpnORq82KDHpkxKtU9qWPAuGjeYDz1tW8ACtpXpu2MbvQ0yJQ-Q Aug 09 18:18:30.794297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:18:30.794297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:18:30.794297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:18:30.794297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:18:30.794297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:18:30.794297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:18:30.794297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: dbd7e50444cc4ef0873bfac9d9a2d514 Aug 09 18:18:30.794297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-460293175 Aug 09 18:18:30.794297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:18:30.794297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:18:30.795997 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dbd7e50444cc4ef0873bfac9d9a2d514"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dbd7e50444cc4ef0873bfac9d9a2d514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dbd7e50444cc4ef0873bfac9d9a2d514", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dbd7e50444cc4ef0873bfac9d9a2d514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:18:30.795997 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-ServerRescueNegativeTestJSON-460293175 Aug 09 18:18:30.795997 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: dbd7e50444cc4ef0873bfac9d9a2d514 Aug 09 18:18:30.795997 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-460293175 Aug 09 18:18:30.795997 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-ServerRescueNegativeTestJSON-460293175-project Aug 09 18:18:30.795997 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:18:30.795997 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:18:30.795997 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: 18fae6990e4148ff97dec28b204c52df Aug 09 18:18:30.795997 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-ServerRescueNegativeTestJSON-460293175-project Aug 09 18:18:30.795997 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Aug 09 18:18:30.795997 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {"volumeAttachment": {"volumeId": "6d1223aa-dc74-41e0-9639-0a1286a73557"}} Aug 09 18:18:30.795997 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: > Aug 09 18:18:30.797000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Cannot 'attach_volume' instance 55a70796-1659-4326-8c40-f33454bc848c while it is in vm_state rescued Aug 09 18:18:30.797000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'server_id': '55a70796-1659-4326-8c40-f33454bc848c', 'body': {'volumeAttachment': {'volumeId': '6d1223aa-dc74-41e0-9639-0a1286a73557'}}} Aug 09 18:18:30.797000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:18:30.797000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:18:30.797000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 18:18:30.797000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 18:18:30.797000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 18:18:30.797000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 18:18:30.797000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 18:18:30.797000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 18:18:30.797000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 55a70796-1659-4326-8c40-f33454bc848c in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 09 18:18:30.797000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:18:30.797000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:18:30.797000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:18:30.797000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:18:30.797000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:18:30.797000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:18:30.797000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:18:30.797000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:18:30.798451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:18:30.798451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:18:30.798451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:18:30.798451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:18:30.798451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:18:30.798451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:18:30.798451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:18:30.798451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:18:30.798451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 09 18:18:30.798451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 18:18:30.798451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 18:18:30.798451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 18:18:30.798451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 55a70796-1659-4326-8c40-f33454bc848c while it is in vm_state rescued Aug 09 18:18:30.798451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:18:30.798451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:18:30.798451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:18:30.798451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:18:30.798451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:18:30.798451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:18:30.799960 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:18:30.799960 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:18:30.799960 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 55a70796-1659-4326-8c40-f33454bc848c while it is in vm_state rescued Aug 09 18:18:30.799960 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:18:30.799960 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-a6808047-b31e-4714-bcfc-484a665b173b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Returning 409 to user: Cannot 'attach_volume' instance 55a70796-1659-4326-8c40-f33454bc848c while it is in vm_state rescued {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:18:30.799960 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-a6808047-b31e-4714-bcfc-484a665b173b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "POST /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043380 Aug 09 18:18:30.799960 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 163/335] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Aug 9 18:18:30 2022] POST /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 18:18:30.805188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9eb498c6-7c4b-4e04-90a1-ff64e593ea06 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:18:30.805660 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9eb498c6-7c4b-4e04-90a1-ff64e593ea06 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:30.811698 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9eb498c6-7c4b-4e04-90a1-ff64e593ea06 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:30.813458 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9eb498c6-7c4b-4e04-90a1-ff64e593ea06 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:30.813458 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9eb498c6-7c4b-4e04-90a1-ff64e593ea06 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:30.813458 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9eb498c6-7c4b-4e04-90a1-ff64e593ea06 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:30.813881 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9eb498c6-7c4b-4e04-90a1-ff64e593ea06 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:30.814312 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9eb498c6-7c4b-4e04-90a1-ff64e593ea06 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:31.007068 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9eb498c6-7c4b-4e04-90a1-ff64e593ea06 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "POST /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c/action" status: 202 len: 0 microversion: 2.1 time: 0.205672 Aug 09 18:18:31.008093 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 173/336] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Aug 9 18:18:30 2022] POST /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:18:31.017350 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-3a1ae09a-c9eb-4fdd-be4b-5e1f7e146524 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:31.018158 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-3a1ae09a-c9eb-4fdd-be4b-5e1f7e146524 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:31.025592 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3a1ae09a-c9eb-4fdd-be4b-5e1f7e146524 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:31.025690 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3a1ae09a-c9eb-4fdd-be4b-5e1f7e146524 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:31.026045 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3a1ae09a-c9eb-4fdd-be4b-5e1f7e146524 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:31.027053 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3a1ae09a-c9eb-4fdd-be4b-5e1f7e146524 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:31.027513 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3a1ae09a-c9eb-4fdd-be4b-5e1f7e146524 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:31.027933 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3a1ae09a-c9eb-4fdd-be4b-5e1f7e146524 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:31.163798 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-3a1ae09a-c9eb-4fdd-be4b-5e1f7e146524 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:31.171519 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-3a1ae09a-c9eb-4fdd-be4b-5e1f7e146524 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1508 microversion: 2.1 time: 0.158922 Aug 09 18:18:31.172083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 164/337] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:31 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:31.443309 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-47058746-4e69-418e-b182-eab82be32dbc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1081282894", "imageRef": "53732c26-c942-4646-ac3f-8d9e11ab4d57", "flavorRef": "452", "networks": [{"uuid": "b943d45b-08a6-4f8e-8c47-f0410b29ac1d"}]}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:18:31.497053 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.network.neutron [None req-47058746-4e69-418e-b182-eab82be32dbc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] validate_networks() for [('b943d45b-08a6-4f8e-8c47-f0410b29ac1d', None, None, None, None, None)] {{(pid=118313) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:18:31.846728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-47058746-4e69-418e-b182-eab82be32dbc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Flavor limits 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:18:31.847292 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-47058746-4e69-418e-b182-eab82be32dbc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Image limits 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:18:31.847644 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-47058746-4e69-418e-b182-eab82be32dbc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Flavor pref 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:18:31.848053 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-47058746-4e69-418e-b182-eab82be32dbc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Image pref 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:18:31.848464 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-47058746-4e69-418e-b182-eab82be32dbc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:18:31.857795 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-47058746-4e69-418e-b182-eab82be32dbc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:31.858275 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-47058746-4e69-418e-b182-eab82be32dbc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:31.858724 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-47058746-4e69-418e-b182-eab82be32dbc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:31.859452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-47058746-4e69-418e-b182-eab82be32dbc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:31.860155 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-47058746-4e69-418e-b182-eab82be32dbc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:31.860579 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-47058746-4e69-418e-b182-eab82be32dbc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:31.876837 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-47058746-4e69-418e-b182-eab82be32dbc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Getting quotas for project 1835c316b47c4cb08db14e0eb6e23c97. Resources: {'cores', 'instances', 'ram'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:18:31.880676 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-47058746-4e69-418e-b182-eab82be32dbc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Getting quotas for user 6ee3fa12c3f448a9a419200051a02ab6 and project 1835c316b47c4cb08db14e0eb6e23c97. Resources: {'cores', 'instances', 'ram'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:18:31.891471 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-47058746-4e69-418e-b182-eab82be32dbc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Going to run 1 instances... {{(pid=118313) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:18:31.893759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-47058746-4e69-418e-b182-eab82be32dbc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53732c26-c942-4646-ac3f-8d9e11ab4d57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118313) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:18:32.002622 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-47058746-4e69-418e-b182-eab82be32dbc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563424 Aug 09 18:18:32.003305 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 174/338] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Aug 9 18:18:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:18:32.014263 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-1a9ad21e-3b2f-482d-bfbf-c84ed285d214 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:32.015514 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-1a9ad21e-3b2f-482d-bfbf-c84ed285d214 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:32.073231 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-1a9ad21e-3b2f-482d-bfbf-c84ed285d214 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:32.080387 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-1a9ad21e-3b2f-482d-bfbf-c84ed285d214 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1219 microversion: 2.1 time: 0.069806 Aug 09 18:18:32.080771 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 165/339] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:32 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:32.192875 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-7491746d-59f5-4df5-905c-c6936bec5bec tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:32.193477 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-7491746d-59f5-4df5-905c-c6936bec5bec tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:32.201644 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7491746d-59f5-4df5-905c-c6936bec5bec tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:32.202126 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7491746d-59f5-4df5-905c-c6936bec5bec tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:32.202563 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7491746d-59f5-4df5-905c-c6936bec5bec tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:32.203271 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7491746d-59f5-4df5-905c-c6936bec5bec tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:32.203731 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7491746d-59f5-4df5-905c-c6936bec5bec tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:32.204149 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7491746d-59f5-4df5-905c-c6936bec5bec tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:32.334182 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-7491746d-59f5-4df5-905c-c6936bec5bec tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:32.342456 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-7491746d-59f5-4df5-905c-c6936bec5bec tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1508 microversion: 2.1 time: 0.153452 Aug 09 18:18:32.343171 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 175/340] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:32 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:33.101204 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-4b23f275-6cbc-4aad-92cb-afbe9cbb695c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:33.101817 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-4b23f275-6cbc-4aad-92cb-afbe9cbb695c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:33.109396 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4b23f275-6cbc-4aad-92cb-afbe9cbb695c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:33.109881 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4b23f275-6cbc-4aad-92cb-afbe9cbb695c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:33.110587 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4b23f275-6cbc-4aad-92cb-afbe9cbb695c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:33.111313 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4b23f275-6cbc-4aad-92cb-afbe9cbb695c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:33.111752 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4b23f275-6cbc-4aad-92cb-afbe9cbb695c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:33.112176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4b23f275-6cbc-4aad-92cb-afbe9cbb695c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:33.185489 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-4b23f275-6cbc-4aad-92cb-afbe9cbb695c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:33.192990 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-4b23f275-6cbc-4aad-92cb-afbe9cbb695c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1223 microversion: 2.1 time: 0.095656 Aug 09 18:18:33.193589 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 166/341] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:33 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:33.363063 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2ae620a6-5304-4250-ad3e-785d0f9be462 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:33.363675 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-2ae620a6-5304-4250-ad3e-785d0f9be462 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:33.369775 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2ae620a6-5304-4250-ad3e-785d0f9be462 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:33.370257 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2ae620a6-5304-4250-ad3e-785d0f9be462 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:33.370690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2ae620a6-5304-4250-ad3e-785d0f9be462 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:33.371393 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2ae620a6-5304-4250-ad3e-785d0f9be462 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:33.371843 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2ae620a6-5304-4250-ad3e-785d0f9be462 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:33.372260 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2ae620a6-5304-4250-ad3e-785d0f9be462 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:33.500416 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-2ae620a6-5304-4250-ad3e-785d0f9be462 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:33.507829 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-2ae620a6-5304-4250-ad3e-785d0f9be462 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1508 microversion: 2.1 time: 0.148766 Aug 09 18:18:33.508393 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 176/342] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:33 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:34.213768 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-9bc15981-8c9c-4847-970b-6cffaa7b2e9f tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:34.214378 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-9bc15981-8c9c-4847-970b-6cffaa7b2e9f tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:34.220884 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9bc15981-8c9c-4847-970b-6cffaa7b2e9f tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:34.221366 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9bc15981-8c9c-4847-970b-6cffaa7b2e9f tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:34.221802 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9bc15981-8c9c-4847-970b-6cffaa7b2e9f tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:34.222487 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9bc15981-8c9c-4847-970b-6cffaa7b2e9f tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:34.222963 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9bc15981-8c9c-4847-970b-6cffaa7b2e9f tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:34.223389 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9bc15981-8c9c-4847-970b-6cffaa7b2e9f tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:34.284021 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-9bc15981-8c9c-4847-970b-6cffaa7b2e9f tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:34.292034 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-9bc15981-8c9c-4847-970b-6cffaa7b2e9f tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1223 microversion: 2.1 time: 0.082311 Aug 09 18:18:34.292598 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 167/343] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:34 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:34.529219 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-08513b9a-7421-4158-960c-ae54164a026e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:34.532690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-08513b9a-7421-4158-960c-ae54164a026e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:34.535924 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-08513b9a-7421-4158-960c-ae54164a026e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:34.536407 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-08513b9a-7421-4158-960c-ae54164a026e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:34.536842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-08513b9a-7421-4158-960c-ae54164a026e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:34.537526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-08513b9a-7421-4158-960c-ae54164a026e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:34.537975 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-08513b9a-7421-4158-960c-ae54164a026e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:34.538394 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-08513b9a-7421-4158-960c-ae54164a026e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:34.672055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-08513b9a-7421-4158-960c-ae54164a026e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:34.679452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-08513b9a-7421-4158-960c-ae54164a026e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1508 microversion: 2.1 time: 0.154083 Aug 09 18:18:34.680020 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 177/344] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:34 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:35.312651 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-14fcf2cb-5e2f-4e2d-a2ff-476c96d8ed98 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:35.313282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-14fcf2cb-5e2f-4e2d-a2ff-476c96d8ed98 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:35.319690 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-14fcf2cb-5e2f-4e2d-a2ff-476c96d8ed98 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:35.320176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-14fcf2cb-5e2f-4e2d-a2ff-476c96d8ed98 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:35.320601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-14fcf2cb-5e2f-4e2d-a2ff-476c96d8ed98 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:35.321513 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-14fcf2cb-5e2f-4e2d-a2ff-476c96d8ed98 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:35.322190 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-14fcf2cb-5e2f-4e2d-a2ff-476c96d8ed98 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:35.322858 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-14fcf2cb-5e2f-4e2d-a2ff-476c96d8ed98 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:35.406517 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-14fcf2cb-5e2f-4e2d-a2ff-476c96d8ed98 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:35.416148 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-14fcf2cb-5e2f-4e2d-a2ff-476c96d8ed98 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1223 microversion: 2.1 time: 0.107296 Aug 09 18:18:35.416771 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 168/345] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:35 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:35.702078 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2debd353-eee3-4461-a515-ba7298098860 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:35.708037 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-2debd353-eee3-4461-a515-ba7298098860 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:35.708938 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2debd353-eee3-4461-a515-ba7298098860 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:35.709431 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2debd353-eee3-4461-a515-ba7298098860 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:35.709871 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2debd353-eee3-4461-a515-ba7298098860 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:35.710568 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2debd353-eee3-4461-a515-ba7298098860 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:35.711222 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2debd353-eee3-4461-a515-ba7298098860 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:35.712338 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2debd353-eee3-4461-a515-ba7298098860 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:35.987941 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-2debd353-eee3-4461-a515-ba7298098860 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:35.990245 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:18:35.996710 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-2debd353-eee3-4461-a515-ba7298098860 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1508 microversion: 2.1 time: 0.299167 Aug 09 18:18:35.997304 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 178/346] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:35 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1508 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:36.437422 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8163afa6-cc15-47aa-93b5-96ce82b16ffc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:36.438445 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8163afa6-cc15-47aa-93b5-96ce82b16ffc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:36.445374 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8163afa6-cc15-47aa-93b5-96ce82b16ffc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:36.446547 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8163afa6-cc15-47aa-93b5-96ce82b16ffc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:36.447049 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8163afa6-cc15-47aa-93b5-96ce82b16ffc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:36.447862 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8163afa6-cc15-47aa-93b5-96ce82b16ffc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:36.448364 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8163afa6-cc15-47aa-93b5-96ce82b16ffc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:36.448792 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8163afa6-cc15-47aa-93b5-96ce82b16ffc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:36.516030 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8163afa6-cc15-47aa-93b5-96ce82b16ffc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:36.523479 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8163afa6-cc15-47aa-93b5-96ce82b16ffc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1271 microversion: 2.1 time: 0.090060 Aug 09 18:18:36.524072 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 169/347] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:36 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:37.024523 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6e3e6c6e-c403-4dbe-ab09-aff25b183526 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:37.025166 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-6e3e6c6e-c403-4dbe-ab09-aff25b183526 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:37.032930 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e3e6c6e-c403-4dbe-ab09-aff25b183526 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:37.033411 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e3e6c6e-c403-4dbe-ab09-aff25b183526 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:37.033845 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e3e6c6e-c403-4dbe-ab09-aff25b183526 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:37.034533 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e3e6c6e-c403-4dbe-ab09-aff25b183526 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:37.035018 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e3e6c6e-c403-4dbe-ab09-aff25b183526 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:37.035475 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e3e6c6e-c403-4dbe-ab09-aff25b183526 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:37.185178 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6e3e6c6e-c403-4dbe-ab09-aff25b183526 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:37.192415 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-6e3e6c6e-c403-4dbe-ab09-aff25b183526 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1508 microversion: 2.1 time: 0.172761 Aug 09 18:18:37.196959 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 179/348] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:37 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:37.544588 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-2de4328e-8486-40b2-bd9b-404955c2b0b2 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:37.545205 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-2de4328e-8486-40b2-bd9b-404955c2b0b2 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:37.551797 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2de4328e-8486-40b2-bd9b-404955c2b0b2 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:37.552283 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2de4328e-8486-40b2-bd9b-404955c2b0b2 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:37.552721 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2de4328e-8486-40b2-bd9b-404955c2b0b2 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:37.553410 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2de4328e-8486-40b2-bd9b-404955c2b0b2 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:37.553864 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2de4328e-8486-40b2-bd9b-404955c2b0b2 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:37.554343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2de4328e-8486-40b2-bd9b-404955c2b0b2 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:37.616323 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-2de4328e-8486-40b2-bd9b-404955c2b0b2 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:37.623867 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-2de4328e-8486-40b2-bd9b-404955c2b0b2 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1279 microversion: 2.1 time: 0.083189 Aug 09 18:18:37.624449 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 170/349] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:37 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1279 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:38.214080 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-50bfc272-9fd3-4a4e-b070-19d4c6e9938b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:38.214605 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-50bfc272-9fd3-4a4e-b070-19d4c6e9938b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:38.220724 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-50bfc272-9fd3-4a4e-b070-19d4c6e9938b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:38.221214 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-50bfc272-9fd3-4a4e-b070-19d4c6e9938b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:38.221658 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-50bfc272-9fd3-4a4e-b070-19d4c6e9938b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:38.222349 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-50bfc272-9fd3-4a4e-b070-19d4c6e9938b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:38.222846 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-50bfc272-9fd3-4a4e-b070-19d4c6e9938b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:38.223277 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-50bfc272-9fd3-4a4e-b070-19d4c6e9938b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:38.350468 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-50bfc272-9fd3-4a4e-b070-19d4c6e9938b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:38.358458 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-50bfc272-9fd3-4a4e-b070-19d4c6e9938b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1508 microversion: 2.1 time: 0.149026 Aug 09 18:18:38.359051 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 180/350] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:38 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:38.645091 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-84f838d0-8a15-42dd-ab9d-50404b8c61a4 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:38.645697 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-84f838d0-8a15-42dd-ab9d-50404b8c61a4 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:38.647955 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=38 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:18:38.653436 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-84f838d0-8a15-42dd-ab9d-50404b8c61a4 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:38.653920 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-84f838d0-8a15-42dd-ab9d-50404b8c61a4 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:38.654355 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-84f838d0-8a15-42dd-ab9d-50404b8c61a4 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:38.655072 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-84f838d0-8a15-42dd-ab9d-50404b8c61a4 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:38.655533 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-84f838d0-8a15-42dd-ab9d-50404b8c61a4 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:38.655949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-84f838d0-8a15-42dd-ab9d-50404b8c61a4 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:38.721302 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-84f838d0-8a15-42dd-ab9d-50404b8c61a4 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:38.729419 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-84f838d0-8a15-42dd-ab9d-50404b8c61a4 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1279 microversion: 2.1 time: 0.088196 Aug 09 18:18:38.729981 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 171/351] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:38 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1279 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:39.379804 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9dde388b-a2f1-4fea-8291-b5ef2d4f0326 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:39.380406 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9dde388b-a2f1-4fea-8291-b5ef2d4f0326 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:39.382238 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:18:39.387605 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9dde388b-a2f1-4fea-8291-b5ef2d4f0326 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:39.388089 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9dde388b-a2f1-4fea-8291-b5ef2d4f0326 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:39.388524 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9dde388b-a2f1-4fea-8291-b5ef2d4f0326 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:39.389205 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9dde388b-a2f1-4fea-8291-b5ef2d4f0326 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:39.389659 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9dde388b-a2f1-4fea-8291-b5ef2d4f0326 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:39.390080 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9dde388b-a2f1-4fea-8291-b5ef2d4f0326 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:39.516812 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9dde388b-a2f1-4fea-8291-b5ef2d4f0326 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:39.524203 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9dde388b-a2f1-4fea-8291-b5ef2d4f0326 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1508 microversion: 2.1 time: 0.148190 Aug 09 18:18:39.524765 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 181/352] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:39 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:39.750146 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-4a990c3b-8c2b-487b-aeb8-027885cd9d91 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:39.750779 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-4a990c3b-8c2b-487b-aeb8-027885cd9d91 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:39.757113 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4a990c3b-8c2b-487b-aeb8-027885cd9d91 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:39.757594 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4a990c3b-8c2b-487b-aeb8-027885cd9d91 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:39.758028 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4a990c3b-8c2b-487b-aeb8-027885cd9d91 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:39.758779 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4a990c3b-8c2b-487b-aeb8-027885cd9d91 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:39.759234 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4a990c3b-8c2b-487b-aeb8-027885cd9d91 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:39.759656 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4a990c3b-8c2b-487b-aeb8-027885cd9d91 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:39.821222 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-4a990c3b-8c2b-487b-aeb8-027885cd9d91 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:39.828576 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-4a990c3b-8c2b-487b-aeb8-027885cd9d91 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1279 microversion: 2.1 time: 0.082231 Aug 09 18:18:39.829134 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 172/353] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:39 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1279 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:40.545553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b60afd0f-4587-49e1-b48c-196ffe06f6cb tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:40.546307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-b60afd0f-4587-49e1-b48c-196ffe06f6cb tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:40.552201 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b60afd0f-4587-49e1-b48c-196ffe06f6cb tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:40.552686 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b60afd0f-4587-49e1-b48c-196ffe06f6cb tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:40.555846 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b60afd0f-4587-49e1-b48c-196ffe06f6cb tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:40.555846 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b60afd0f-4587-49e1-b48c-196ffe06f6cb tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:40.555846 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b60afd0f-4587-49e1-b48c-196ffe06f6cb tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:40.555846 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b60afd0f-4587-49e1-b48c-196ffe06f6cb tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:40.793391 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b60afd0f-4587-49e1-b48c-196ffe06f6cb tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:40.801281 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b60afd0f-4587-49e1-b48c-196ffe06f6cb tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1508 microversion: 2.1 time: 0.259558 Aug 09 18:18:40.801848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 182/354] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:40 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:40.849507 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-71e6aef9-4dba-4976-a27d-bca709e2ef80 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:40.850219 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-71e6aef9-4dba-4976-a27d-bca709e2ef80 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:40.857375 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-71e6aef9-4dba-4976-a27d-bca709e2ef80 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:40.857865 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-71e6aef9-4dba-4976-a27d-bca709e2ef80 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:40.858301 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-71e6aef9-4dba-4976-a27d-bca709e2ef80 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:40.859043 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-71e6aef9-4dba-4976-a27d-bca709e2ef80 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:40.859487 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-71e6aef9-4dba-4976-a27d-bca709e2ef80 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:40.859910 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-71e6aef9-4dba-4976-a27d-bca709e2ef80 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:41.242332 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-71e6aef9-4dba-4976-a27d-bca709e2ef80 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:41.248775 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-71e6aef9-4dba-4976-a27d-bca709e2ef80 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1319 microversion: 2.1 time: 0.403261 Aug 09 18:18:41.249337 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 173/355] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:40 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1319 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:41.823856 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a2017061-0571-4145-b14f-4ac86ef126e9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:41.824304 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a2017061-0571-4145-b14f-4ac86ef126e9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:41.830093 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a2017061-0571-4145-b14f-4ac86ef126e9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:41.830630 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a2017061-0571-4145-b14f-4ac86ef126e9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:41.831066 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a2017061-0571-4145-b14f-4ac86ef126e9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:41.831758 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a2017061-0571-4145-b14f-4ac86ef126e9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:41.832215 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a2017061-0571-4145-b14f-4ac86ef126e9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:41.832640 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a2017061-0571-4145-b14f-4ac86ef126e9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:41.868155 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=2 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:18:41.887627 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=6 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:18:42.032398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a2017061-0571-4145-b14f-4ac86ef126e9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:42.040020 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a2017061-0571-4145-b14f-4ac86ef126e9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1508 microversion: 2.1 time: 0.220619 Aug 09 18:18:42.040586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 183/356] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:41 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1508 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:42.147409 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-ce883d8d-6f9c-4daf-9a88-ca09c21859bc req-4fad8b35-d87f-4842-a84c-0b7c13e4daa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a38a4836-74e4-447e-a029-9a9f2fee6e4c", "tag": "8f2c0cc7-cb57-4dcd-af3a-a8fb648404a6"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:18:42.153462 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=2 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:18:42.158580 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-ce883d8d-6f9c-4daf-9a88-ca09c21859bc req-4fad8b35-d87f-4842-a84c-0b7c13e4daa1 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:42.159098 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-ce883d8d-6f9c-4daf-9a88-ca09c21859bc req-4fad8b35-d87f-4842-a84c-0b7c13e4daa1 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:42.159530 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-ce883d8d-6f9c-4daf-9a88-ca09c21859bc req-4fad8b35-d87f-4842-a84c-0b7c13e4daa1 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:42.170456 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-ce883d8d-6f9c-4daf-9a88-ca09c21859bc req-4fad8b35-d87f-4842-a84c-0b7c13e4daa1 service nova] Creating event network-changed:8f2c0cc7-cb57-4dcd-af3a-a8fb648404a6 for instance a38a4836-74e4-447e-a029-9a9f2fee6e4c on hv-cinder-79797 Aug 09 18:18:42.175690 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-ce883d8d-6f9c-4daf-9a88-ca09c21859bc req-4fad8b35-d87f-4842-a84c-0b7c13e4daa1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031890 Aug 09 18:18:42.176462 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 174/357] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:18:42.269685 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a62ca2c4-e5d4-4bfb-8b2c-28f82372fb5c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:42.270297 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a62ca2c4-e5d4-4bfb-8b2c-28f82372fb5c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:42.277459 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a62ca2c4-e5d4-4bfb-8b2c-28f82372fb5c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:42.277951 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a62ca2c4-e5d4-4bfb-8b2c-28f82372fb5c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:42.278380 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a62ca2c4-e5d4-4bfb-8b2c-28f82372fb5c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:42.279162 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a62ca2c4-e5d4-4bfb-8b2c-28f82372fb5c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:42.279612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a62ca2c4-e5d4-4bfb-8b2c-28f82372fb5c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:42.280035 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a62ca2c4-e5d4-4bfb-8b2c-28f82372fb5c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:42.417779 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a62ca2c4-e5d4-4bfb-8b2c-28f82372fb5c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:42.425187 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a62ca2c4-e5d4-4bfb-8b2c-28f82372fb5c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1319 microversion: 2.1 time: 0.159388 Aug 09 18:18:42.425795 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 184/358] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:42 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:43.063507 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8d6b4f4d-a67d-4b27-9152-7a8eabd1746b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:43.063507 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8d6b4f4d-a67d-4b27-9152-7a8eabd1746b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:43.069910 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8d6b4f4d-a67d-4b27-9152-7a8eabd1746b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:43.070397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8d6b4f4d-a67d-4b27-9152-7a8eabd1746b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:43.070866 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8d6b4f4d-a67d-4b27-9152-7a8eabd1746b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:43.072200 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8d6b4f4d-a67d-4b27-9152-7a8eabd1746b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:43.072656 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8d6b4f4d-a67d-4b27-9152-7a8eabd1746b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:43.073081 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8d6b4f4d-a67d-4b27-9152-7a8eabd1746b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:43.216865 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8d6b4f4d-a67d-4b27-9152-7a8eabd1746b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:43.234854 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8d6b4f4d-a67d-4b27-9152-7a8eabd1746b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1508 microversion: 2.1 time: 0.176565 Aug 09 18:18:43.235696 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 175/359] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:43 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:43.447013 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-fa434d8c-7033-47f2-8e13-7d7cb32958f9 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:43.448367 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-fa434d8c-7033-47f2-8e13-7d7cb32958f9 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:43.454870 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fa434d8c-7033-47f2-8e13-7d7cb32958f9 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:43.455570 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fa434d8c-7033-47f2-8e13-7d7cb32958f9 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:43.456004 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fa434d8c-7033-47f2-8e13-7d7cb32958f9 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:43.456849 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fa434d8c-7033-47f2-8e13-7d7cb32958f9 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:43.457449 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fa434d8c-7033-47f2-8e13-7d7cb32958f9 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:43.457871 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fa434d8c-7033-47f2-8e13-7d7cb32958f9 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:43.623011 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-fa434d8c-7033-47f2-8e13-7d7cb32958f9 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:43.630307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-fa434d8c-7033-47f2-8e13-7d7cb32958f9 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1319 microversion: 2.1 time: 0.187624 Aug 09 18:18:43.630890 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 185/360] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:43 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:44.258905 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-b11a56c3-c089-46af-8d81-ab9d6f56c475 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:44.262324 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-b11a56c3-c089-46af-8d81-ab9d6f56c475 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:44.270009 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b11a56c3-c089-46af-8d81-ab9d6f56c475 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:44.270492 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b11a56c3-c089-46af-8d81-ab9d6f56c475 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:44.270954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b11a56c3-c089-46af-8d81-ab9d6f56c475 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:44.271641 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b11a56c3-c089-46af-8d81-ab9d6f56c475 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:44.272092 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b11a56c3-c089-46af-8d81-ab9d6f56c475 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:44.272505 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b11a56c3-c089-46af-8d81-ab9d6f56c475 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:44.450569 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-b11a56c3-c089-46af-8d81-ab9d6f56c475 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:44.459169 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-b11a56c3-c089-46af-8d81-ab9d6f56c475 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1514 microversion: 2.1 time: 0.205239 Aug 09 18:18:44.470728 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 176/361] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:44 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1514 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:44.651387 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-7090b2d0-fb48-4461-b2a7-175184f7e518 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:44.652067 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-7090b2d0-fb48-4461-b2a7-175184f7e518 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:44.658286 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7090b2d0-fb48-4461-b2a7-175184f7e518 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:44.658876 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7090b2d0-fb48-4461-b2a7-175184f7e518 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:44.659373 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7090b2d0-fb48-4461-b2a7-175184f7e518 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:44.660141 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7090b2d0-fb48-4461-b2a7-175184f7e518 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:44.660664 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7090b2d0-fb48-4461-b2a7-175184f7e518 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:44.661148 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7090b2d0-fb48-4461-b2a7-175184f7e518 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:44.800124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-7090b2d0-fb48-4461-b2a7-175184f7e518 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:44.823229 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-7090b2d0-fb48-4461-b2a7-175184f7e518 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1319 microversion: 2.1 time: 0.175777 Aug 09 18:18:44.823903 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 186/362] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:44 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:45.843857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-5d39a9f1-e424-459d-9f99-bb51e3e7face tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:45.844463 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-5d39a9f1-e424-459d-9f99-bb51e3e7face tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:45.850923 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d39a9f1-e424-459d-9f99-bb51e3e7face tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:45.851339 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d39a9f1-e424-459d-9f99-bb51e3e7face tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:45.851764 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d39a9f1-e424-459d-9f99-bb51e3e7face tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:45.852484 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d39a9f1-e424-459d-9f99-bb51e3e7face tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:45.852934 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d39a9f1-e424-459d-9f99-bb51e3e7face tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:45.853405 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d39a9f1-e424-459d-9f99-bb51e3e7face tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:46.020815 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-5d39a9f1-e424-459d-9f99-bb51e3e7face tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:46.029154 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-5d39a9f1-e424-459d-9f99-bb51e3e7face tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1319 microversion: 2.1 time: 0.189004 Aug 09 18:18:46.029725 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 177/363] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:45 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:46.172038 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d738fcdc-556e-4416-a621-a47633320e91 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Action: 'create', calling method: .version_select at 0x7f4c35d1caf0>, body: {"keypair": {"name": "tempest-keypair-684107855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVsvC3sg/ErMOE9bF4+77rMBl/IaqTBKgtvy3OGwtX5ck2YrFqb1+7C/4cU1ROpER3lZJQXXFopB+FEyKP0jHbLnqA2rMwAJ6cvm43VUoWmu3yv4VLXUX2luz1TAVcapQ=="}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:18:46.189495 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-d738fcdc-556e-4416-a621-a47633320e91 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Getting quotas for project dbd7e50444cc4ef0873bfac9d9a2d514. Resources: {'key_pairs'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:18:46.193406 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-d738fcdc-556e-4416-a621-a47633320e91 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Getting quotas for user 18fae6990e4148ff97dec28b204c52df and project dbd7e50444cc4ef0873bfac9d9a2d514. Resources: {'key_pairs'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:18:46.300372 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d738fcdc-556e-4416-a621-a47633320e91 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.132106 Aug 09 18:18:46.300903 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 187/364] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Aug 9 18:18:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:18:47.050934 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-75f12ad6-7b1e-4fa9-8b99-dec14194a4f6 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:47.051542 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-75f12ad6-7b1e-4fa9-8b99-dec14194a4f6 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:47.057990 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-75f12ad6-7b1e-4fa9-8b99-dec14194a4f6 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:47.058471 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-75f12ad6-7b1e-4fa9-8b99-dec14194a4f6 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:47.058935 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-75f12ad6-7b1e-4fa9-8b99-dec14194a4f6 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:47.059627 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-75f12ad6-7b1e-4fa9-8b99-dec14194a4f6 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:47.060080 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-75f12ad6-7b1e-4fa9-8b99-dec14194a4f6 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:47.060503 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-75f12ad6-7b1e-4fa9-8b99-dec14194a4f6 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:47.078464 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=100 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:18:47.205417 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-75f12ad6-7b1e-4fa9-8b99-dec14194a4f6 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:47.214140 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-75f12ad6-7b1e-4fa9-8b99-dec14194a4f6 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1319 microversion: 2.1 time: 0.167020 Aug 09 18:18:47.220508 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 178/365] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:47 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:48.237305 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f495159b-fbe4-4d3e-a9dc-124cdcf0e279 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:48.238825 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f495159b-fbe4-4d3e-a9dc-124cdcf0e279 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:48.247947 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f495159b-fbe4-4d3e-a9dc-124cdcf0e279 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:48.248732 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f495159b-fbe4-4d3e-a9dc-124cdcf0e279 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:48.249334 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f495159b-fbe4-4d3e-a9dc-124cdcf0e279 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:48.250228 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f495159b-fbe4-4d3e-a9dc-124cdcf0e279 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:48.250878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f495159b-fbe4-4d3e-a9dc-124cdcf0e279 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:48.251458 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f495159b-fbe4-4d3e-a9dc-124cdcf0e279 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:48.489921 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f495159b-fbe4-4d3e-a9dc-124cdcf0e279 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:48.497734 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f495159b-fbe4-4d3e-a9dc-124cdcf0e279 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1319 microversion: 2.1 time: 0.266583 Aug 09 18:18:48.498438 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 188/366] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:48 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:48.884599 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-b1a7317e-5768-40b0-8c6a-fef27ee7065c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-360797516", "imageRef": "53732c26-c942-4646-ac3f-8d9e11ab4d57", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03ed61e4-08cc-4115-8e7b-4a7bf5a548a8"}], "security_groups": [{"name": "tempest-securitygroup--505146761"}], "key_name": "tempest-keypair-684107855", "user_data": "}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:18:48.989174 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.network.neutron [None req-b1a7317e-5768-40b0-8c6a-fef27ee7065c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] validate_networks() for [('03ed61e4-08cc-4115-8e7b-4a7bf5a548a8', None, None, None, None, None)] {{(pid=118314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:18:49.355695 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-b1a7317e-5768-40b0-8c6a-fef27ee7065c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Flavor limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:18:49.356263 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-b1a7317e-5768-40b0-8c6a-fef27ee7065c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Image limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:18:49.356767 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-b1a7317e-5768-40b0-8c6a-fef27ee7065c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Flavor pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:18:49.357172 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-b1a7317e-5768-40b0-8c6a-fef27ee7065c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Image pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:18:49.357702 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-b1a7317e-5768-40b0-8c6a-fef27ee7065c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:18:49.366424 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b1a7317e-5768-40b0-8c6a-fef27ee7065c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:49.366939 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b1a7317e-5768-40b0-8c6a-fef27ee7065c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:49.367370 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b1a7317e-5768-40b0-8c6a-fef27ee7065c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:49.368126 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b1a7317e-5768-40b0-8c6a-fef27ee7065c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:49.368876 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b1a7317e-5768-40b0-8c6a-fef27ee7065c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:49.369311 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b1a7317e-5768-40b0-8c6a-fef27ee7065c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:49.386426 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-b1a7317e-5768-40b0-8c6a-fef27ee7065c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Getting quotas for project dbd7e50444cc4ef0873bfac9d9a2d514. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:18:49.390288 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-b1a7317e-5768-40b0-8c6a-fef27ee7065c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Getting quotas for user 18fae6990e4148ff97dec28b204c52df and project dbd7e50444cc4ef0873bfac9d9a2d514. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:18:49.401887 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-b1a7317e-5768-40b0-8c6a-fef27ee7065c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Going to run 1 instances... {{(pid=118314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:18:49.404260 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-b1a7317e-5768-40b0-8c6a-fef27ee7065c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53732c26-c942-4646-ac3f-8d9e11ab4d57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:18:49.518985 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-3efd79cf-5f31-45cd-b287-1fd26a1d60f6 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:49.519519 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-3efd79cf-5f31-45cd-b287-1fd26a1d60f6 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:49.526325 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3efd79cf-5f31-45cd-b287-1fd26a1d60f6 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:49.526844 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3efd79cf-5f31-45cd-b287-1fd26a1d60f6 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:49.527488 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3efd79cf-5f31-45cd-b287-1fd26a1d60f6 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:49.528193 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3efd79cf-5f31-45cd-b287-1fd26a1d60f6 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:49.528652 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3efd79cf-5f31-45cd-b287-1fd26a1d60f6 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:49.529081 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3efd79cf-5f31-45cd-b287-1fd26a1d60f6 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:49.578921 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b1a7317e-5768-40b0-8c6a-fef27ee7065c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [0f2e9135-2917-44a0-8d36-d435d3ddc174] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 18:18:49.679054 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-3efd79cf-5f31-45cd-b287-1fd26a1d60f6 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:49.686865 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-3efd79cf-5f31-45cd-b287-1fd26a1d60f6 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1319 microversion: 2.1 time: 0.171921 Aug 09 18:18:49.687411 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 189/367] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:49 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:50.577288 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO oslo.messaging._drivers.impl_rabbit [None req-b1a7317e-5768-40b0-8c6a-fef27ee7065c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [0f2e9135-2917-44a0-8d36-d435d3ddc174] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 56596. Aug 09 18:18:50.581793 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-b1a7317e-5768-40b0-8c6a-fef27ee7065c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.702073 Aug 09 18:18:50.584872 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 179/368] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Aug 9 18:18:48 2022] POST /compute/v2.1/servers => generated 408 bytes in 1706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:18:50.596218 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-62e17255-83ec-471a-b480-058634756969 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:50.596830 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-62e17255-83ec-471a-b480-058634756969 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:50.653314 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-62e17255-83ec-471a-b480-058634756969 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:50.658791 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-62e17255-83ec-471a-b480-058634756969 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1244 microversion: 2.1 time: 0.066374 Aug 09 18:18:50.659357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 190/369] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:50 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1244 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:50.708154 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-762ebfaf-8542-425e-a7f8-f043f4c27301 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:50.708770 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-762ebfaf-8542-425e-a7f8-f043f4c27301 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:50.715533 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-762ebfaf-8542-425e-a7f8-f043f4c27301 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:50.716014 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-762ebfaf-8542-425e-a7f8-f043f4c27301 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:50.716507 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-762ebfaf-8542-425e-a7f8-f043f4c27301 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:50.717122 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-762ebfaf-8542-425e-a7f8-f043f4c27301 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:50.717576 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-762ebfaf-8542-425e-a7f8-f043f4c27301 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:50.717998 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-762ebfaf-8542-425e-a7f8-f043f4c27301 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:50.853222 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-762ebfaf-8542-425e-a7f8-f043f4c27301 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:50.860801 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-762ebfaf-8542-425e-a7f8-f043f4c27301 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1319 microversion: 2.1 time: 0.156515 Aug 09 18:18:50.861356 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 180/370] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:50 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:51.680506 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-14ecd75a-c7de-4775-a0c4-67e4682e7765 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:51.681174 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-14ecd75a-c7de-4775-a0c4-67e4682e7765 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:51.693936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-14ecd75a-c7de-4775-a0c4-67e4682e7765 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:51.694433 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-14ecd75a-c7de-4775-a0c4-67e4682e7765 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:51.694896 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-14ecd75a-c7de-4775-a0c4-67e4682e7765 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:51.695597 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-14ecd75a-c7de-4775-a0c4-67e4682e7765 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:51.696055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-14ecd75a-c7de-4775-a0c4-67e4682e7765 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:51.697038 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-14ecd75a-c7de-4775-a0c4-67e4682e7765 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:51.759788 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-14ecd75a-c7de-4775-a0c4-67e4682e7765 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:51.766973 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-14ecd75a-c7de-4775-a0c4-67e4682e7765 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1248 microversion: 2.1 time: 0.090144 Aug 09 18:18:51.767520 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 191/371] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:51 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1248 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:51.883070 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-b702156b-9209-4a9f-942f-c9ece85f21be tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:51.883719 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-b702156b-9209-4a9f-942f-c9ece85f21be tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:51.892190 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b702156b-9209-4a9f-942f-c9ece85f21be tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:51.893360 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b702156b-9209-4a9f-942f-c9ece85f21be tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:51.894953 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b702156b-9209-4a9f-942f-c9ece85f21be tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:51.895680 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b702156b-9209-4a9f-942f-c9ece85f21be tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:51.896138 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b702156b-9209-4a9f-942f-c9ece85f21be tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:51.896561 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b702156b-9209-4a9f-942f-c9ece85f21be tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:52.032342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-b702156b-9209-4a9f-942f-c9ece85f21be tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:52.039764 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-b702156b-9209-4a9f-942f-c9ece85f21be tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1319 microversion: 2.1 time: 0.161086 Aug 09 18:18:52.040413 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 181/372] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:51 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:52.789100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-7cd5ab63-59f2-499c-ba54-234ae1b25478 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:52.789734 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-7cd5ab63-59f2-499c-ba54-234ae1b25478 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:52.796401 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7cd5ab63-59f2-499c-ba54-234ae1b25478 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:52.801072 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7cd5ab63-59f2-499c-ba54-234ae1b25478 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:52.801072 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7cd5ab63-59f2-499c-ba54-234ae1b25478 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:52.801072 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7cd5ab63-59f2-499c-ba54-234ae1b25478 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:52.801072 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7cd5ab63-59f2-499c-ba54-234ae1b25478 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:52.801448 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7cd5ab63-59f2-499c-ba54-234ae1b25478 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:52.874075 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-7cd5ab63-59f2-499c-ba54-234ae1b25478 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:52.881882 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-7cd5ab63-59f2-499c-ba54-234ae1b25478 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1314 microversion: 2.1 time: 0.096482 Aug 09 18:18:52.882837 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 192/373] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:52 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1314 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:53.062111 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-aebddae5-3ee7-4fb2-b107-166cfa2e5135 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:53.062752 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-aebddae5-3ee7-4fb2-b107-166cfa2e5135 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:53.069747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aebddae5-3ee7-4fb2-b107-166cfa2e5135 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:53.070285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aebddae5-3ee7-4fb2-b107-166cfa2e5135 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:53.072110 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aebddae5-3ee7-4fb2-b107-166cfa2e5135 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:53.072852 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aebddae5-3ee7-4fb2-b107-166cfa2e5135 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:53.073322 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aebddae5-3ee7-4fb2-b107-166cfa2e5135 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:53.078416 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aebddae5-3ee7-4fb2-b107-166cfa2e5135 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:53.078668 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-a22fcd2e-f7bd-4888-bd15-11ef7334a4e3 req-80967016-121d-46f5-bbdf-abe435defb88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a38a4836-74e4-447e-a029-9a9f2fee6e4c", "name": "network-vif-plugged", "status": "completed", "tag": "8f2c0cc7-cb57-4dcd-af3a-a8fb648404a6"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:18:53.087928 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-a22fcd2e-f7bd-4888-bd15-11ef7334a4e3 req-80967016-121d-46f5-bbdf-abe435defb88 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:53.088643 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-a22fcd2e-f7bd-4888-bd15-11ef7334a4e3 req-80967016-121d-46f5-bbdf-abe435defb88 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:53.089318 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-a22fcd2e-f7bd-4888-bd15-11ef7334a4e3 req-80967016-121d-46f5-bbdf-abe435defb88 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:53.101871 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-a22fcd2e-f7bd-4888-bd15-11ef7334a4e3 req-80967016-121d-46f5-bbdf-abe435defb88 service nova] Creating event network-vif-plugged:8f2c0cc7-cb57-4dcd-af3a-a8fb648404a6 for instance a38a4836-74e4-447e-a029-9a9f2fee6e4c on hv-cinder-79797 Aug 09 18:18:53.108614 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-a22fcd2e-f7bd-4888-bd15-11ef7334a4e3 req-80967016-121d-46f5-bbdf-abe435defb88 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040700 Aug 09 18:18:53.109852 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 193/374] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:18:53.541989 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-aebddae5-3ee7-4fb2-b107-166cfa2e5135 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:53.549462 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-aebddae5-3ee7-4fb2-b107-166cfa2e5135 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1319 microversion: 2.1 time: 0.493019 Aug 09 18:18:53.549963 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 182/375] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:53 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1319 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:53.905354 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-dd5817f0-e74b-4140-8d89-7a4b5e98201c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:53.906045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-dd5817f0-e74b-4140-8d89-7a4b5e98201c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:53.912630 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dd5817f0-e74b-4140-8d89-7a4b5e98201c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:53.913128 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dd5817f0-e74b-4140-8d89-7a4b5e98201c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:53.913572 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dd5817f0-e74b-4140-8d89-7a4b5e98201c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:53.914275 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dd5817f0-e74b-4140-8d89-7a4b5e98201c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:53.914826 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dd5817f0-e74b-4140-8d89-7a4b5e98201c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:53.915342 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dd5817f0-e74b-4140-8d89-7a4b5e98201c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:54.113634 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-dd5817f0-e74b-4140-8d89-7a4b5e98201c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:54.121110 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-dd5817f0-e74b-4140-8d89-7a4b5e98201c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.220369 Aug 09 18:18:54.121781 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 194/376] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:53 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:54.570844 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8c5f512f-6b41-4a45-ae8e-64383c584a39 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:54.571636 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8c5f512f-6b41-4a45-ae8e-64383c584a39 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:54.578111 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c5f512f-6b41-4a45-ae8e-64383c584a39 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:54.578681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c5f512f-6b41-4a45-ae8e-64383c584a39 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:54.579245 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c5f512f-6b41-4a45-ae8e-64383c584a39 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:54.580200 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c5f512f-6b41-4a45-ae8e-64383c584a39 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:54.580729 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c5f512f-6b41-4a45-ae8e-64383c584a39 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:54.581227 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c5f512f-6b41-4a45-ae8e-64383c584a39 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:54.767090 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8c5f512f-6b41-4a45-ae8e-64383c584a39 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:54.774436 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8c5f512f-6b41-4a45-ae8e-64383c584a39 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1319 microversion: 2.1 time: 0.207445 Aug 09 18:18:54.775682 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 183/377] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:54 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:54.853257 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-303eb2cc-0626-4a9e-ae25-088de207670a req-78292426-49d5-4e73-8fd5-fea59e5103e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "245f64c6-0159-4c0d-816e-8cd5213fd655", "tag": "35a445c4-7451-48bc-a24d-97a7becfc3de"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:18:54.866363 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-303eb2cc-0626-4a9e-ae25-088de207670a req-78292426-49d5-4e73-8fd5-fea59e5103e9 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:54.866881 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-303eb2cc-0626-4a9e-ae25-088de207670a req-78292426-49d5-4e73-8fd5-fea59e5103e9 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:54.867508 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-303eb2cc-0626-4a9e-ae25-088de207670a req-78292426-49d5-4e73-8fd5-fea59e5103e9 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:54.879142 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-303eb2cc-0626-4a9e-ae25-088de207670a req-78292426-49d5-4e73-8fd5-fea59e5103e9 service nova] Creating event network-changed:35a445c4-7451-48bc-a24d-97a7becfc3de for instance 245f64c6-0159-4c0d-816e-8cd5213fd655 on hv-cinder-79797 Aug 09 18:18:54.884014 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-303eb2cc-0626-4a9e-ae25-088de207670a req-78292426-49d5-4e73-8fd5-fea59e5103e9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042313 Aug 09 18:18:54.884597 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 195/378] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:18:55.145612 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-edd140d8-7c27-4549-bc7c-c9a7128406c7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:55.146377 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-edd140d8-7c27-4549-bc7c-c9a7128406c7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:55.153601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-edd140d8-7c27-4549-bc7c-c9a7128406c7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:55.154308 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-edd140d8-7c27-4549-bc7c-c9a7128406c7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:55.154916 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-edd140d8-7c27-4549-bc7c-c9a7128406c7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:55.156094 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-edd140d8-7c27-4549-bc7c-c9a7128406c7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:55.156917 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-edd140d8-7c27-4549-bc7c-c9a7128406c7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:55.157696 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-edd140d8-7c27-4549-bc7c-c9a7128406c7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:55.362750 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-edd140d8-7c27-4549-bc7c-c9a7128406c7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:55.374907 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-edd140d8-7c27-4549-bc7c-c9a7128406c7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.236055 Aug 09 18:18:55.375492 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 184/379] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:55 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:55.797593 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-cab92df5-934a-4232-9a83-fb6c9c19419c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:55.798295 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-cab92df5-934a-4232-9a83-fb6c9c19419c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:55.805028 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cab92df5-934a-4232-9a83-fb6c9c19419c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:55.805547 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cab92df5-934a-4232-9a83-fb6c9c19419c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:55.805982 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cab92df5-934a-4232-9a83-fb6c9c19419c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:55.806672 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cab92df5-934a-4232-9a83-fb6c9c19419c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:55.807149 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cab92df5-934a-4232-9a83-fb6c9c19419c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:55.808244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cab92df5-934a-4232-9a83-fb6c9c19419c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:56.066249 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-cab92df5-934a-4232-9a83-fb6c9c19419c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:56.074841 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-cab92df5-934a-4232-9a83-fb6c9c19419c tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1508 microversion: 2.1 time: 0.281828 Aug 09 18:18:56.075736 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 196/380] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:55 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1508 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:56.396713 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-9f04dc77-3f55-4cf4-a6c5-457c06070bf2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:56.397986 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-9f04dc77-3f55-4cf4-a6c5-457c06070bf2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:56.405479 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f04dc77-3f55-4cf4-a6c5-457c06070bf2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:56.405978 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f04dc77-3f55-4cf4-a6c5-457c06070bf2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:56.406428 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f04dc77-3f55-4cf4-a6c5-457c06070bf2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:56.407252 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f04dc77-3f55-4cf4-a6c5-457c06070bf2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:56.407986 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f04dc77-3f55-4cf4-a6c5-457c06070bf2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:56.408262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f04dc77-3f55-4cf4-a6c5-457c06070bf2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:56.550758 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-9f04dc77-3f55-4cf4-a6c5-457c06070bf2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:56.558199 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-9f04dc77-3f55-4cf4-a6c5-457c06070bf2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.165191 Aug 09 18:18:56.558815 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 185/381] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:56 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:56.582416 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:18:56.582575 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Tue Aug 9 18:18:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:18:57.580521 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-4d4066cc-39a3-4cd9-be51-390464799245 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:57.581248 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-4d4066cc-39a3-4cd9-be51-390464799245 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:57.592002 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d4066cc-39a3-4cd9-be51-390464799245 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:57.592621 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d4066cc-39a3-4cd9-be51-390464799245 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:57.593067 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d4066cc-39a3-4cd9-be51-390464799245 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:57.593901 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d4066cc-39a3-4cd9-be51-390464799245 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:57.594987 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d4066cc-39a3-4cd9-be51-390464799245 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:57.596503 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d4066cc-39a3-4cd9-be51-390464799245 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:57.756272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4d4066cc-39a3-4cd9-be51-390464799245 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:57.767144 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-4d4066cc-39a3-4cd9-be51-390464799245 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.190946 Aug 09 18:18:57.767821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 197/382] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:57 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:58.788264 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-203c8016-9686-4276-ae70-ee20965469bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:58.788866 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-203c8016-9686-4276-ae70-ee20965469bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:58.795570 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-203c8016-9686-4276-ae70-ee20965469bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:58.796048 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-203c8016-9686-4276-ae70-ee20965469bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:58.796476 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-203c8016-9686-4276-ae70-ee20965469bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:58.797159 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-203c8016-9686-4276-ae70-ee20965469bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:58.797623 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-203c8016-9686-4276-ae70-ee20965469bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:58.798040 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-203c8016-9686-4276-ae70-ee20965469bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:58.930554 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-203c8016-9686-4276-ae70-ee20965469bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:58.938885 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-203c8016-9686-4276-ae70-ee20965469bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.154412 Aug 09 18:18:58.939444 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 186/383] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:58 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:59.960816 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5490ded9-3cc2-48c3-8919-d99bfa599e50 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:59.962266 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-5490ded9-3cc2-48c3-8919-d99bfa599e50 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:59.968604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5490ded9-3cc2-48c3-8919-d99bfa599e50 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:59.972696 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5490ded9-3cc2-48c3-8919-d99bfa599e50 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:59.973369 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5490ded9-3cc2-48c3-8919-d99bfa599e50 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:59.974385 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5490ded9-3cc2-48c3-8919-d99bfa599e50 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:59.975052 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5490ded9-3cc2-48c3-8919-d99bfa599e50 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:59.975637 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5490ded9-3cc2-48c3-8919-d99bfa599e50 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:00.162267 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-5490ded9-3cc2-48c3-8919-d99bfa599e50 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:00.164915 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=100 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:19:00.173370 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-5490ded9-3cc2-48c3-8919-d99bfa599e50 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.216439 Aug 09 18:19:00.175781 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 198/384] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:59 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:01.196232 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-ff7bd192-0b69-4c36-9bd1-f2c2a55f9ec7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:01.196849 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-ff7bd192-0b69-4c36-9bd1-f2c2a55f9ec7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:01.199413 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=2 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:19:01.214287 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=6 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:19:01.214287 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ff7bd192-0b69-4c36-9bd1-f2c2a55f9ec7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:01.214287 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ff7bd192-0b69-4c36-9bd1-f2c2a55f9ec7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:01.214287 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ff7bd192-0b69-4c36-9bd1-f2c2a55f9ec7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:01.215069 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ff7bd192-0b69-4c36-9bd1-f2c2a55f9ec7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:01.215069 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ff7bd192-0b69-4c36-9bd1-f2c2a55f9ec7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:01.215069 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ff7bd192-0b69-4c36-9bd1-f2c2a55f9ec7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:01.351729 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-ff7bd192-0b69-4c36-9bd1-f2c2a55f9ec7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:01.358308 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-ff7bd192-0b69-4c36-9bd1-f2c2a55f9ec7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.166244 Aug 09 18:19:01.358903 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 187/385] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:01 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:02.379507 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-541f91fc-a788-4220-9ae5-698c2fed607e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:02.380124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-541f91fc-a788-4220-9ae5-698c2fed607e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:02.383965 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=6 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:19:02.388700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-541f91fc-a788-4220-9ae5-698c2fed607e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:02.389197 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-541f91fc-a788-4220-9ae5-698c2fed607e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:02.389832 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-541f91fc-a788-4220-9ae5-698c2fed607e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:02.390538 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-541f91fc-a788-4220-9ae5-698c2fed607e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:02.391033 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-541f91fc-a788-4220-9ae5-698c2fed607e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:02.391463 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-541f91fc-a788-4220-9ae5-698c2fed607e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:02.591382 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-541f91fc-a788-4220-9ae5-698c2fed607e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:02.599861 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-541f91fc-a788-4220-9ae5-698c2fed607e tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.224217 Aug 09 18:19:02.600438 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 199/386] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:02 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:03.624169 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-4251ab8d-d6ec-46d3-aabc-99b570b9c20c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:03.624791 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-4251ab8d-d6ec-46d3-aabc-99b570b9c20c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:03.640955 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4251ab8d-d6ec-46d3-aabc-99b570b9c20c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:03.641732 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4251ab8d-d6ec-46d3-aabc-99b570b9c20c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:03.642433 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4251ab8d-d6ec-46d3-aabc-99b570b9c20c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:03.643902 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4251ab8d-d6ec-46d3-aabc-99b570b9c20c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:03.644612 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4251ab8d-d6ec-46d3-aabc-99b570b9c20c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:03.645302 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4251ab8d-d6ec-46d3-aabc-99b570b9c20c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:04.035819 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-4251ab8d-d6ec-46d3-aabc-99b570b9c20c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:04.044605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-4251ab8d-d6ec-46d3-aabc-99b570b9c20c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.426709 Aug 09 18:19:04.046354 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 188/387] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:03 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:05.067244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-71c3acfd-5a6c-433b-9aab-95610ea53b1b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:05.068861 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-71c3acfd-5a6c-433b-9aab-95610ea53b1b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:05.076194 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-71c3acfd-5a6c-433b-9aab-95610ea53b1b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:05.076810 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-71c3acfd-5a6c-433b-9aab-95610ea53b1b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:05.077484 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-71c3acfd-5a6c-433b-9aab-95610ea53b1b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:05.078419 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-71c3acfd-5a6c-433b-9aab-95610ea53b1b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:05.079117 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-71c3acfd-5a6c-433b-9aab-95610ea53b1b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:05.079688 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-71c3acfd-5a6c-433b-9aab-95610ea53b1b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:05.259610 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-71c3acfd-5a6c-433b-9aab-95610ea53b1b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:05.268234 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-71c3acfd-5a6c-433b-9aab-95610ea53b1b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.204680 Aug 09 18:19:05.279432 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 200/388] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:05 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:06.289851 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-2081c07d-9e65-4231-b62b-44dbe19cdd48 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:06.291197 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-2081c07d-9e65-4231-b62b-44dbe19cdd48 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:06.298287 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2081c07d-9e65-4231-b62b-44dbe19cdd48 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:06.299049 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2081c07d-9e65-4231-b62b-44dbe19cdd48 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:06.299762 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2081c07d-9e65-4231-b62b-44dbe19cdd48 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:06.300529 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2081c07d-9e65-4231-b62b-44dbe19cdd48 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:06.301056 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2081c07d-9e65-4231-b62b-44dbe19cdd48 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:06.301546 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2081c07d-9e65-4231-b62b-44dbe19cdd48 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:06.458211 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-2081c07d-9e65-4231-b62b-44dbe19cdd48 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:06.475205 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-2081c07d-9e65-4231-b62b-44dbe19cdd48 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.182805 Aug 09 18:19:06.475205 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 189/389] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:06 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:07.493603 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c76515df-a134-406d-b096-79aa90377276 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:07.494232 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-c76515df-a134-406d-b096-79aa90377276 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:07.505825 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c76515df-a134-406d-b096-79aa90377276 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:07.510460 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c76515df-a134-406d-b096-79aa90377276 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:07.510460 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c76515df-a134-406d-b096-79aa90377276 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:07.510460 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c76515df-a134-406d-b096-79aa90377276 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:07.510460 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c76515df-a134-406d-b096-79aa90377276 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:07.511101 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c76515df-a134-406d-b096-79aa90377276 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:07.705656 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-c76515df-a134-406d-b096-79aa90377276 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:07.727735 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-c76515df-a134-406d-b096-79aa90377276 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.237480 Aug 09 18:19:07.729869 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 201/390] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:07 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:08.756351 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-2bbd705a-7d5f-4f78-ae64-a48704cee990 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:08.757561 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-2bbd705a-7d5f-4f78-ae64-a48704cee990 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:08.760244 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:19:08.764119 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2bbd705a-7d5f-4f78-ae64-a48704cee990 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:08.764543 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2bbd705a-7d5f-4f78-ae64-a48704cee990 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:08.765178 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2bbd705a-7d5f-4f78-ae64-a48704cee990 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:08.765884 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2bbd705a-7d5f-4f78-ae64-a48704cee990 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:08.766342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2bbd705a-7d5f-4f78-ae64-a48704cee990 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:08.766833 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2bbd705a-7d5f-4f78-ae64-a48704cee990 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:09.050237 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-2bbd705a-7d5f-4f78-ae64-a48704cee990 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:09.059675 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-2bbd705a-7d5f-4f78-ae64-a48704cee990 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.306986 Aug 09 18:19:09.060979 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 190/391] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:08 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:09.505545 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-5175e6bb-39fd-4b65-93b9-2baeb26168f0 req-94441ada-d20c-4e8b-ab95-16bf2b8a364c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "245f64c6-0159-4c0d-816e-8cd5213fd655", "name": "network-vif-plugged", "status": "completed", "tag": "35a445c4-7451-48bc-a24d-97a7becfc3de"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:19:09.512985 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:19:09.517633 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-5175e6bb-39fd-4b65-93b9-2baeb26168f0 req-94441ada-d20c-4e8b-ab95-16bf2b8a364c service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:09.518181 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-5175e6bb-39fd-4b65-93b9-2baeb26168f0 req-94441ada-d20c-4e8b-ab95-16bf2b8a364c service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:09.518741 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-5175e6bb-39fd-4b65-93b9-2baeb26168f0 req-94441ada-d20c-4e8b-ab95-16bf2b8a364c service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:09.533548 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-5175e6bb-39fd-4b65-93b9-2baeb26168f0 req-94441ada-d20c-4e8b-ab95-16bf2b8a364c service nova] Creating event network-vif-plugged:35a445c4-7451-48bc-a24d-97a7becfc3de for instance 245f64c6-0159-4c0d-816e-8cd5213fd655 on hv-cinder-79797 Aug 09 18:19:09.539072 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-5175e6bb-39fd-4b65-93b9-2baeb26168f0 req-94441ada-d20c-4e8b-ab95-16bf2b8a364c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037731 Aug 09 18:19:09.540080 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 202/392] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:19:10.082384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-0ee5715e-e165-4680-b6b8-26aaed0ad117 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:10.083722 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-0ee5715e-e165-4680-b6b8-26aaed0ad117 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:10.090653 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0ee5715e-e165-4680-b6b8-26aaed0ad117 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:10.091226 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0ee5715e-e165-4680-b6b8-26aaed0ad117 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:10.092175 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0ee5715e-e165-4680-b6b8-26aaed0ad117 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:10.092913 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0ee5715e-e165-4680-b6b8-26aaed0ad117 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:10.093369 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0ee5715e-e165-4680-b6b8-26aaed0ad117 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:10.094001 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0ee5715e-e165-4680-b6b8-26aaed0ad117 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:10.307096 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-0ee5715e-e165-4680-b6b8-26aaed0ad117 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:10.315624 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-0ee5715e-e165-4680-b6b8-26aaed0ad117 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.237913 Aug 09 18:19:10.316654 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 191/393] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:10 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:11.144295 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-eba2c0a3-9620-4072-9954-c1853e91e4ee tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Action: 'create', calling method: .version_select at 0x7f4c35f4fc10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1622559993", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmPlj5Ijjn51mvzp5Xqw1Lo8g0ucSzSYG955X0rr2GW2HkGEIKN/0tXp7pHHp0QWj4VgilwqMftXtrpmjVoQKeTEwGC1FzzzeeGdOzjI1TbTRVknbDiz7l32rcTzHQzRw=="}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:19:11.159983 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-eba2c0a3-9620-4072-9954-c1853e91e4ee tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Getting quotas for project ab313819a4b141fc8391e750896f8b33. Resources: {'key_pairs'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:19:11.163907 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-eba2c0a3-9620-4072-9954-c1853e91e4ee tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Getting quotas for user 46f8e315028640a7a2106c23018bf158 and project ab313819a4b141fc8391e750896f8b33. Resources: {'key_pairs'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:19:11.251319 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-eba2c0a3-9620-4072-9954-c1853e91e4ee tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.287609 Aug 09 18:19:11.251929 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 203/394] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Aug 9 18:19:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:19:11.339511 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-294807c5-dbcf-44fb-a891-7b18a55ff89b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:11.340292 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-294807c5-dbcf-44fb-a891-7b18a55ff89b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:11.349557 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-294807c5-dbcf-44fb-a891-7b18a55ff89b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:11.350045 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-294807c5-dbcf-44fb-a891-7b18a55ff89b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:11.350475 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-294807c5-dbcf-44fb-a891-7b18a55ff89b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:11.351197 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-294807c5-dbcf-44fb-a891-7b18a55ff89b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:11.351648 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-294807c5-dbcf-44fb-a891-7b18a55ff89b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:11.352064 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-294807c5-dbcf-44fb-a891-7b18a55ff89b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:11.550038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-294807c5-dbcf-44fb-a891-7b18a55ff89b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:11.558123 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-294807c5-dbcf-44fb-a891-7b18a55ff89b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.223109 Aug 09 18:19:11.559125 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 192/395] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:11 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:12.580011 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5e8cc3ef-82b1-490c-914f-8ec81457324b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:12.580738 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-5e8cc3ef-82b1-490c-914f-8ec81457324b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:12.586912 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5e8cc3ef-82b1-490c-914f-8ec81457324b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:12.588075 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5e8cc3ef-82b1-490c-914f-8ec81457324b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:12.588075 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5e8cc3ef-82b1-490c-914f-8ec81457324b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:12.588604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5e8cc3ef-82b1-490c-914f-8ec81457324b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:12.589059 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5e8cc3ef-82b1-490c-914f-8ec81457324b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:12.589487 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5e8cc3ef-82b1-490c-914f-8ec81457324b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:12.720923 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-5e8cc3ef-82b1-490c-914f-8ec81457324b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:12.728456 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-5e8cc3ef-82b1-490c-914f-8ec81457324b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.152303 Aug 09 18:19:12.729524 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 204/396] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:12 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:13.751649 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c8eb4ccc-587d-4ef4-a883-fd8b8d0b6610 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:13.752266 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c8eb4ccc-587d-4ef4-a883-fd8b8d0b6610 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:13.759582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c8eb4ccc-587d-4ef4-a883-fd8b8d0b6610 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:13.760074 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c8eb4ccc-587d-4ef4-a883-fd8b8d0b6610 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:13.760512 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c8eb4ccc-587d-4ef4-a883-fd8b8d0b6610 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:13.761395 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c8eb4ccc-587d-4ef4-a883-fd8b8d0b6610 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:13.761855 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c8eb4ccc-587d-4ef4-a883-fd8b8d0b6610 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:13.762986 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c8eb4ccc-587d-4ef4-a883-fd8b8d0b6610 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:13.903366 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c8eb4ccc-587d-4ef4-a883-fd8b8d0b6610 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:13.915741 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c8eb4ccc-587d-4ef4-a883-fd8b8d0b6610 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.167180 Aug 09 18:19:13.916976 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 193/397] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:13 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:19:14.937996 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-988fe526-8741-4482-84c9-42dfa31c414a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:14.938599 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-988fe526-8741-4482-84c9-42dfa31c414a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:14.944858 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-988fe526-8741-4482-84c9-42dfa31c414a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:14.945348 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-988fe526-8741-4482-84c9-42dfa31c414a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:14.945779 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-988fe526-8741-4482-84c9-42dfa31c414a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:14.946468 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-988fe526-8741-4482-84c9-42dfa31c414a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:14.946946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-988fe526-8741-4482-84c9-42dfa31c414a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:14.947365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-988fe526-8741-4482-84c9-42dfa31c414a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:15.100795 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-988fe526-8741-4482-84c9-42dfa31c414a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:15.109438 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-988fe526-8741-4482-84c9-42dfa31c414a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.176128 Aug 09 18:19:15.110698 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 205/398] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:14 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:16.132307 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-a1b06b3b-a03f-4a34-b792-24874c678e12 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:16.132896 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-a1b06b3b-a03f-4a34-b792-24874c678e12 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:16.140044 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a1b06b3b-a03f-4a34-b792-24874c678e12 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:16.140519 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a1b06b3b-a03f-4a34-b792-24874c678e12 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:16.140944 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a1b06b3b-a03f-4a34-b792-24874c678e12 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:16.141623 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a1b06b3b-a03f-4a34-b792-24874c678e12 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:16.142072 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a1b06b3b-a03f-4a34-b792-24874c678e12 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:16.142487 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a1b06b3b-a03f-4a34-b792-24874c678e12 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:16.282696 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a1b06b3b-a03f-4a34-b792-24874c678e12 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:16.290208 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-a1b06b3b-a03f-4a34-b792-24874c678e12 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.161747 Aug 09 18:19:16.290910 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 194/399] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:16 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:17.312162 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-0324ee80-0eeb-44d2-9d31-d7d1a101ba09 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:17.312875 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-0324ee80-0eeb-44d2-9d31-d7d1a101ba09 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:17.318799 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0324ee80-0eeb-44d2-9d31-d7d1a101ba09 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:17.319278 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0324ee80-0eeb-44d2-9d31-d7d1a101ba09 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:17.319712 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0324ee80-0eeb-44d2-9d31-d7d1a101ba09 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:17.320393 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0324ee80-0eeb-44d2-9d31-d7d1a101ba09 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:17.320846 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0324ee80-0eeb-44d2-9d31-d7d1a101ba09 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:17.321270 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0324ee80-0eeb-44d2-9d31-d7d1a101ba09 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:17.454030 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-0324ee80-0eeb-44d2-9d31-d7d1a101ba09 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:17.477209 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-0324ee80-0eeb-44d2-9d31-d7d1a101ba09 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.169304 Aug 09 18:19:17.477839 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 206/400] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:17 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:18.498619 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-43575737-1495-4d77-8a99-5f0600684d07 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:18.499307 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-43575737-1495-4d77-8a99-5f0600684d07 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:18.505650 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-43575737-1495-4d77-8a99-5f0600684d07 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:18.506136 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-43575737-1495-4d77-8a99-5f0600684d07 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:18.506569 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-43575737-1495-4d77-8a99-5f0600684d07 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:18.507295 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-43575737-1495-4d77-8a99-5f0600684d07 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:18.507754 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-43575737-1495-4d77-8a99-5f0600684d07 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:18.508177 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-43575737-1495-4d77-8a99-5f0600684d07 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:18.510913 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=95 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:19:18.647536 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-43575737-1495-4d77-8a99-5f0600684d07 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:18.656890 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-43575737-1495-4d77-8a99-5f0600684d07 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.162421 Aug 09 18:19:18.658364 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 195/401] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:18 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:19.678007 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-ede980e6-c1dc-4e5f-b179-815e5cdad5e5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:19.678523 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-ede980e6-c1dc-4e5f-b179-815e5cdad5e5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:19.684651 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ede980e6-c1dc-4e5f-b179-815e5cdad5e5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:19.685137 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ede980e6-c1dc-4e5f-b179-815e5cdad5e5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:19.686090 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ede980e6-c1dc-4e5f-b179-815e5cdad5e5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:19.686809 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ede980e6-c1dc-4e5f-b179-815e5cdad5e5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:19.687271 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ede980e6-c1dc-4e5f-b179-815e5cdad5e5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:19.687699 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ede980e6-c1dc-4e5f-b179-815e5cdad5e5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:19.821953 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ede980e6-c1dc-4e5f-b179-815e5cdad5e5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:19.830303 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-ede980e6-c1dc-4e5f-b179-815e5cdad5e5 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.156212 Aug 09 18:19:19.830906 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 207/402] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:19 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:20.851824 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-32196d54-c6b2-4469-8ce6-00c9b6b08a61 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:20.852557 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-32196d54-c6b2-4469-8ce6-00c9b6b08a61 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:20.859284 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-32196d54-c6b2-4469-8ce6-00c9b6b08a61 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:20.859773 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-32196d54-c6b2-4469-8ce6-00c9b6b08a61 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:20.860647 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-32196d54-c6b2-4469-8ce6-00c9b6b08a61 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:20.861612 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-32196d54-c6b2-4469-8ce6-00c9b6b08a61 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:20.862287 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-32196d54-c6b2-4469-8ce6-00c9b6b08a61 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:20.862939 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-32196d54-c6b2-4469-8ce6-00c9b6b08a61 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:20.997575 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-32196d54-c6b2-4469-8ce6-00c9b6b08a61 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:21.005223 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-32196d54-c6b2-4469-8ce6-00c9b6b08a61 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.157491 Aug 09 18:19:21.005781 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 196/403] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:20 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:22.027544 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9f61db6f-73a0-4c42-b6f6-11067e12cd69 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:22.028200 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9f61db6f-73a0-4c42-b6f6-11067e12cd69 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:22.030772 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=4 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:19:22.035921 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9f61db6f-73a0-4c42-b6f6-11067e12cd69 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:22.036407 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9f61db6f-73a0-4c42-b6f6-11067e12cd69 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:22.036841 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9f61db6f-73a0-4c42-b6f6-11067e12cd69 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:22.037529 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9f61db6f-73a0-4c42-b6f6-11067e12cd69 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:22.037979 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9f61db6f-73a0-4c42-b6f6-11067e12cd69 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:22.038396 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9f61db6f-73a0-4c42-b6f6-11067e12cd69 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:22.168529 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9f61db6f-73a0-4c42-b6f6-11067e12cd69 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:22.176799 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9f61db6f-73a0-4c42-b6f6-11067e12cd69 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.153758 Aug 09 18:19:22.177356 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 208/404] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:22 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:23.197587 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-65dde4f6-dfbc-4d8f-a6fb-ddd9dc8cda55 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:23.198104 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-65dde4f6-dfbc-4d8f-a6fb-ddd9dc8cda55 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:23.204442 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-65dde4f6-dfbc-4d8f-a6fb-ddd9dc8cda55 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:23.204926 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-65dde4f6-dfbc-4d8f-a6fb-ddd9dc8cda55 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:23.205355 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-65dde4f6-dfbc-4d8f-a6fb-ddd9dc8cda55 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:23.206036 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-65dde4f6-dfbc-4d8f-a6fb-ddd9dc8cda55 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:23.206488 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-65dde4f6-dfbc-4d8f-a6fb-ddd9dc8cda55 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:23.207534 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-65dde4f6-dfbc-4d8f-a6fb-ddd9dc8cda55 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:23.335797 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-65dde4f6-dfbc-4d8f-a6fb-ddd9dc8cda55 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:23.343198 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-65dde4f6-dfbc-4d8f-a6fb-ddd9dc8cda55 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.149513 Aug 09 18:19:23.343759 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 197/405] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:23 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:24.364761 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-bb57cd2f-9fb2-491a-b449-ed39303730c6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:24.365370 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-bb57cd2f-9fb2-491a-b449-ed39303730c6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:24.371483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bb57cd2f-9fb2-491a-b449-ed39303730c6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:24.371969 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bb57cd2f-9fb2-491a-b449-ed39303730c6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:24.372404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bb57cd2f-9fb2-491a-b449-ed39303730c6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:24.373093 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bb57cd2f-9fb2-491a-b449-ed39303730c6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:24.373552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bb57cd2f-9fb2-491a-b449-ed39303730c6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:24.373974 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bb57cd2f-9fb2-491a-b449-ed39303730c6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:24.518331 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-bb57cd2f-9fb2-491a-b449-ed39303730c6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:24.526330 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-bb57cd2f-9fb2-491a-b449-ed39303730c6 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1369 microversion: 2.1 time: 0.166386 Aug 09 18:19:24.526959 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 209/406] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:24 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:25.547897 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d9e3b3fe-d3f7-48cb-9248-7d4230219cab tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:25.548501 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d9e3b3fe-d3f7-48cb-9248-7d4230219cab tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:25.555686 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d9e3b3fe-d3f7-48cb-9248-7d4230219cab tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:25.556172 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d9e3b3fe-d3f7-48cb-9248-7d4230219cab tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:25.556713 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d9e3b3fe-d3f7-48cb-9248-7d4230219cab tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:25.557398 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d9e3b3fe-d3f7-48cb-9248-7d4230219cab tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:25.557848 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d9e3b3fe-d3f7-48cb-9248-7d4230219cab tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:25.558297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d9e3b3fe-d3f7-48cb-9248-7d4230219cab tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:25.690642 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d9e3b3fe-d3f7-48cb-9248-7d4230219cab tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:25.699121 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d9e3b3fe-d3f7-48cb-9248-7d4230219cab tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1564 microversion: 2.1 time: 0.154989 Aug 09 18:19:25.699698 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 198/407] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:25 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:25.721847 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-907faa5a-e556-4b6d-8b64-f70df64aba66 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:25.722950 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-907faa5a-e556-4b6d-8b64-f70df64aba66 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:25.728979 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-907faa5a-e556-4b6d-8b64-f70df64aba66 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:25.729501 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-907faa5a-e556-4b6d-8b64-f70df64aba66 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:25.729938 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-907faa5a-e556-4b6d-8b64-f70df64aba66 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:25.730631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-907faa5a-e556-4b6d-8b64-f70df64aba66 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:25.731163 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-907faa5a-e556-4b6d-8b64-f70df64aba66 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:25.731714 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-907faa5a-e556-4b6d-8b64-f70df64aba66 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:25.816487 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-907faa5a-e556-4b6d-8b64-f70df64aba66 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098294 Aug 09 18:19:25.817175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 210/408] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Aug 9 18:19:25 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:19:27.041321 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-a4ed4025-2386-4fca-bac0-65f2b675c7ae req-c3a3fc92-16c7-467b-acfe-fd8b4d99c359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "245f64c6-0159-4c0d-816e-8cd5213fd655", "tag": "35a445c4-7451-48bc-a24d-97a7becfc3de"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:19:27.051475 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-a4ed4025-2386-4fca-bac0-65f2b675c7ae req-c3a3fc92-16c7-467b-acfe-fd8b4d99c359 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:27.051958 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-a4ed4025-2386-4fca-bac0-65f2b675c7ae req-c3a3fc92-16c7-467b-acfe-fd8b4d99c359 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:27.052388 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-a4ed4025-2386-4fca-bac0-65f2b675c7ae req-c3a3fc92-16c7-467b-acfe-fd8b4d99c359 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:27.063500 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-a4ed4025-2386-4fca-bac0-65f2b675c7ae req-c3a3fc92-16c7-467b-acfe-fd8b4d99c359 service nova] Creating event network-changed:35a445c4-7451-48bc-a24d-97a7becfc3de for instance 245f64c6-0159-4c0d-816e-8cd5213fd655 on hv-cinder-79797 Aug 09 18:19:27.069507 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-a4ed4025-2386-4fca-bac0-65f2b675c7ae req-c3a3fc92-16c7-467b-acfe-fd8b4d99c359 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031991 Aug 09 18:19:27.070101 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 199/409] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:19:35.228999 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6542f691-34a8-42e5-afac-1f649f4af7b7 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "657f3d04-3e1b-4527-b278-09d755372bcc", "device": "/dev/sdb"}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:19:35.249756 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-6542f691-34a8-42e5-afac-1f649f4af7b7 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:35.249756 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6542f691-34a8-42e5-afac-1f649f4af7b7 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:35.249756 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6542f691-34a8-42e5-afac-1f649f4af7b7 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:35.249756 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6542f691-34a8-42e5-afac-1f649f4af7b7 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:35.250169 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6542f691-34a8-42e5-afac-1f649f4af7b7 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:35.250169 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6542f691-34a8-42e5-afac-1f649f4af7b7 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:35.250169 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6542f691-34a8-42e5-afac-1f649f4af7b7 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:35.250169 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=62 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:19:35.922522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-6542f691-34a8-42e5-afac-1f649f4af7b7 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "POST /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.697384 Aug 09 18:19:35.927065 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 211/410] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Aug 9 18:19:35 2022] POST /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c/os-volume_attachments => generated 194 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:19:43.358751 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-368013fe-b314-40bc-99c3-e30a78358b59 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:43.359398 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-368013fe-b314-40bc-99c3-e30a78358b59 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:43.362121 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=19 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:19:43.362810 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=25 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:19:43.368589 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-368013fe-b314-40bc-99c3-e30a78358b59 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:43.369064 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-368013fe-b314-40bc-99c3-e30a78358b59 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:43.369488 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-368013fe-b314-40bc-99c3-e30a78358b59 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:43.370179 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-368013fe-b314-40bc-99c3-e30a78358b59 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:43.370628 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-368013fe-b314-40bc-99c3-e30a78358b59 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:43.371076 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-368013fe-b314-40bc-99c3-e30a78358b59 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:43.397884 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-368013fe-b314-40bc-99c3-e30a78358b59 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/ips" status: 200 len: 152 microversion: 2.20 time: 0.041702 Aug 09 18:19:43.397884 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 200/411] 10.222.0.36 () {60 vars in 1289 bytes} [Tue Aug 9 18:19:43 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:19:45.214452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f4e8dc28-f498-4567-8fee-a6604db5bcb1 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1569324396", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1622559993", "security_groups": [{"name": "tempest-secgroup-smoke-2127014821"}], "networks": [{"uuid": "4dae2628-2195-4505-b34d-c4911ec31dbb"}], "block_device_mapping_v2": [{"uuid": "8db8c1e3-f69e-43a6-84d5-f319fac9ee22", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:19:45.224686 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:19:45.332102 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.network.neutron [None req-f4e8dc28-f498-4567-8fee-a6604db5bcb1 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] validate_networks() for [('4dae2628-2195-4505-b34d-c4911ec31dbb', None, None, None, None, None)] {{(pid=118313) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:19:45.627890 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-20d89537-2900-4d0c-8980-d73c0cf2c0f8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:19:45.628459 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-20d89537-2900-4d0c-8980-d73c0cf2c0f8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:45.636266 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-20d89537-2900-4d0c-8980-d73c0cf2c0f8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:45.636745 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-20d89537-2900-4d0c-8980-d73c0cf2c0f8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:45.637173 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-20d89537-2900-4d0c-8980-d73c0cf2c0f8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:45.637853 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-20d89537-2900-4d0c-8980-d73c0cf2c0f8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:45.638298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-20d89537-2900-4d0c-8980-d73c0cf2c0f8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:45.638735 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-20d89537-2900-4d0c-8980-d73c0cf2c0f8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:45.662189 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.objects.instance [None req-20d89537-2900-4d0c-8980-d73c0cf2c0f8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lazy-loading 'flavor' on Instance uuid 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 {{(pid=118314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:19:45.705300 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-f4e8dc28-f498-4567-8fee-a6604db5bcb1 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Flavor limits 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:19:45.705751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-f4e8dc28-f498-4567-8fee-a6604db5bcb1 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Image limits 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:19:45.706229 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-f4e8dc28-f498-4567-8fee-a6604db5bcb1 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Flavor pref 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:19:45.706637 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-f4e8dc28-f498-4567-8fee-a6604db5bcb1 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Image pref 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:19:45.707074 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-f4e8dc28-f498-4567-8fee-a6604db5bcb1 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:19:45.716520 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f4e8dc28-f498-4567-8fee-a6604db5bcb1 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:45.724411 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f4e8dc28-f498-4567-8fee-a6604db5bcb1 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:45.724411 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f4e8dc28-f498-4567-8fee-a6604db5bcb1 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:45.724411 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f4e8dc28-f498-4567-8fee-a6604db5bcb1 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:45.724411 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f4e8dc28-f498-4567-8fee-a6604db5bcb1 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:45.724814 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f4e8dc28-f498-4567-8fee-a6604db5bcb1 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:45.735174 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-f4e8dc28-f498-4567-8fee-a6604db5bcb1 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Getting quotas for project ab313819a4b141fc8391e750896f8b33. Resources: {'cores', 'instances', 'ram'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:19:45.739660 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-f4e8dc28-f498-4567-8fee-a6604db5bcb1 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Getting quotas for user 46f8e315028640a7a2106c23018bf158 and project ab313819a4b141fc8391e750896f8b33. Resources: {'cores', 'instances', 'ram'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:19:45.798260 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f4e8dc28-f498-4567-8fee-a6604db5bcb1 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Going to run 1 instances... {{(pid=118313) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:19:45.800453 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f4e8dc28-f498-4567-8fee-a6604db5bcb1 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8db8c1e3-f69e-43a6-84d5-f319fac9ee22',volume_size=None,volume_type=None)] {{(pid=118313) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:19:46.094323 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-20d89537-2900-4d0c-8980-d73c0cf2c0f8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "POST /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/action" status: 202 len: 0 microversion: 2.20 time: 0.470214 Aug 09 18:19:46.098184 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 201/412] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Aug 9 18:19:45 2022] POST /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:19:46.104427 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-5a6fbf23-770f-424d-b101-79040f4b9893 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:46.105125 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-5a6fbf23-770f-424d-b101-79040f4b9893 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:46.111850 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5a6fbf23-770f-424d-b101-79040f4b9893 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:46.112335 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5a6fbf23-770f-424d-b101-79040f4b9893 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:46.112770 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5a6fbf23-770f-424d-b101-79040f4b9893 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:46.113571 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5a6fbf23-770f-424d-b101-79040f4b9893 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:46.114024 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5a6fbf23-770f-424d-b101-79040f4b9893 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:46.114588 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5a6fbf23-770f-424d-b101-79040f4b9893 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:46.200368 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f4e8dc28-f498-4567-8fee-a6604db5bcb1 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.990252 Aug 09 18:19:46.201183 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 212/413] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Aug 9 18:19:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:19:46.213255 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e01bc9d0-c569-466d-bc65-64fb7b123677 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:46.214132 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e01bc9d0-c569-466d-bc65-64fb7b123677 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:46.282912 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-5a6fbf23-770f-424d-b101-79040f4b9893 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:46.285711 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e01bc9d0-c569-466d-bc65-64fb7b123677 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:46.291675 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-5a6fbf23-770f-424d-b101-79040f4b9893 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:46.293278 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-5a6fbf23-770f-424d-b101-79040f4b9893 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:46.294448 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-5a6fbf23-770f-424d-b101-79040f4b9893 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.194813 Aug 09 18:19:46.295048 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 202/414] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:19:46 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:19:46.301499 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e01bc9d0-c569-466d-bc65-64fb7b123677 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1089 microversion: 2.1 time: 0.093524 Aug 09 18:19:46.302240 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 213/415] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:46 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1089 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:19:47.317247 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-86cd4b21-e6bf-4b39-bdad-9a67da1b3af9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:47.318500 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-86cd4b21-e6bf-4b39-bdad-9a67da1b3af9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:47.322089 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-76e53cf5-cf4e-454a-a156-fce64b198ed3 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:47.322906 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-76e53cf5-cf4e-454a-a156-fce64b198ed3 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:47.325437 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-86cd4b21-e6bf-4b39-bdad-9a67da1b3af9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:47.325928 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-86cd4b21-e6bf-4b39-bdad-9a67da1b3af9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:47.326394 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-86cd4b21-e6bf-4b39-bdad-9a67da1b3af9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:47.327123 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-86cd4b21-e6bf-4b39-bdad-9a67da1b3af9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:47.327576 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-86cd4b21-e6bf-4b39-bdad-9a67da1b3af9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:47.328000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-86cd4b21-e6bf-4b39-bdad-9a67da1b3af9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:47.329722 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-76e53cf5-cf4e-454a-a156-fce64b198ed3 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:47.335587 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-76e53cf5-cf4e-454a-a156-fce64b198ed3 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:47.335587 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-76e53cf5-cf4e-454a-a156-fce64b198ed3 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:47.335587 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-76e53cf5-cf4e-454a-a156-fce64b198ed3 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:47.335587 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-76e53cf5-cf4e-454a-a156-fce64b198ed3 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:47.336156 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-76e53cf5-cf4e-454a-a156-fce64b198ed3 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:47.415043 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-76e53cf5-cf4e-454a-a156-fce64b198ed3 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:47.422408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-76e53cf5-cf4e-454a-a156-fce64b198ed3 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1139 microversion: 2.1 time: 0.104040 Aug 09 18:19:47.423000 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 214/416] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:47 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1139 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:19:47.489017 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-86cd4b21-e6bf-4b39-bdad-9a67da1b3af9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:47.497785 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-86cd4b21-e6bf-4b39-bdad-9a67da1b3af9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:47.499249 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-86cd4b21-e6bf-4b39-bdad-9a67da1b3af9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:47.500393 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-86cd4b21-e6bf-4b39-bdad-9a67da1b3af9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.187196 Aug 09 18:19:47.500944 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 203/417] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:19:47 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:19:48.444377 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a4e91c75-5da5-4935-9526-1fee201e9f2e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:48.445016 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a4e91c75-5da5-4935-9526-1fee201e9f2e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:48.453006 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a4e91c75-5da5-4935-9526-1fee201e9f2e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:48.453492 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a4e91c75-5da5-4935-9526-1fee201e9f2e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:48.453937 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a4e91c75-5da5-4935-9526-1fee201e9f2e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:48.454633 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a4e91c75-5da5-4935-9526-1fee201e9f2e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:48.455119 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a4e91c75-5da5-4935-9526-1fee201e9f2e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:48.455543 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a4e91c75-5da5-4935-9526-1fee201e9f2e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:48.519860 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a4e91c75-5da5-4935-9526-1fee201e9f2e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:48.523206 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-b8edae72-0309-458e-885c-66eb084121cd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:48.524001 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-b8edae72-0309-458e-885c-66eb084121cd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:48.528089 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a4e91c75-5da5-4935-9526-1fee201e9f2e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1139 microversion: 2.1 time: 0.088262 Aug 09 18:19:48.528734 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 215/418] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:48 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1139 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:48.530528 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8edae72-0309-458e-885c-66eb084121cd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:48.531112 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8edae72-0309-458e-885c-66eb084121cd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:48.531617 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8edae72-0309-458e-885c-66eb084121cd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:48.532419 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8edae72-0309-458e-885c-66eb084121cd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:48.532993 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8edae72-0309-458e-885c-66eb084121cd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:48.533480 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8edae72-0309-458e-885c-66eb084121cd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:48.668261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-b8edae72-0309-458e-885c-66eb084121cd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:48.676033 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-b8edae72-0309-458e-885c-66eb084121cd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:48.677543 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-b8edae72-0309-458e-885c-66eb084121cd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:48.678692 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-b8edae72-0309-458e-885c-66eb084121cd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.159416 Aug 09 18:19:48.679273 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 204/419] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:19:48 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:19:49.549163 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-33a0bbba-baeb-4034-93d4-f5d60fe93e47 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:49.549772 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-33a0bbba-baeb-4034-93d4-f5d60fe93e47 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:49.556876 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-33a0bbba-baeb-4034-93d4-f5d60fe93e47 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:49.563161 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-33a0bbba-baeb-4034-93d4-f5d60fe93e47 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:49.563161 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-33a0bbba-baeb-4034-93d4-f5d60fe93e47 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:49.563161 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-33a0bbba-baeb-4034-93d4-f5d60fe93e47 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:49.563161 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-33a0bbba-baeb-4034-93d4-f5d60fe93e47 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:49.563557 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-33a0bbba-baeb-4034-93d4-f5d60fe93e47 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:49.620501 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-33a0bbba-baeb-4034-93d4-f5d60fe93e47 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:49.628470 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-33a0bbba-baeb-4034-93d4-f5d60fe93e47 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1139 microversion: 2.1 time: 0.083185 Aug 09 18:19:49.632218 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 216/420] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:49 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:49.701620 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-15e0e370-f5da-4f2a-90ae-4f6f2602ff00 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:49.702169 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-15e0e370-f5da-4f2a-90ae-4f6f2602ff00 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:49.708837 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15e0e370-f5da-4f2a-90ae-4f6f2602ff00 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:49.712465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15e0e370-f5da-4f2a-90ae-4f6f2602ff00 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:49.712465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15e0e370-f5da-4f2a-90ae-4f6f2602ff00 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:49.712465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15e0e370-f5da-4f2a-90ae-4f6f2602ff00 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:49.712465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15e0e370-f5da-4f2a-90ae-4f6f2602ff00 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:49.712867 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15e0e370-f5da-4f2a-90ae-4f6f2602ff00 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:49.844198 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-15e0e370-f5da-4f2a-90ae-4f6f2602ff00 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:49.853461 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-15e0e370-f5da-4f2a-90ae-4f6f2602ff00 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:49.855028 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-15e0e370-f5da-4f2a-90ae-4f6f2602ff00 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:49.856171 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-15e0e370-f5da-4f2a-90ae-4f6f2602ff00 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.158634 Aug 09 18:19:49.856774 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 205/421] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:19:49 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:19:50.649652 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-57edf99c-c20b-4e28-98ff-cb574ef746eb tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:50.650449 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-57edf99c-c20b-4e28-98ff-cb574ef746eb tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:50.656850 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-57edf99c-c20b-4e28-98ff-cb574ef746eb tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:50.657273 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-57edf99c-c20b-4e28-98ff-cb574ef746eb tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:50.657710 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-57edf99c-c20b-4e28-98ff-cb574ef746eb tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:50.658412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-57edf99c-c20b-4e28-98ff-cb574ef746eb tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:50.658939 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-57edf99c-c20b-4e28-98ff-cb574ef746eb tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:50.659392 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-57edf99c-c20b-4e28-98ff-cb574ef746eb tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:50.720829 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-57edf99c-c20b-4e28-98ff-cb574ef746eb tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:50.728477 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-57edf99c-c20b-4e28-98ff-cb574ef746eb tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1187 microversion: 2.1 time: 0.082844 Aug 09 18:19:50.729072 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 217/422] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:50 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1187 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:50.880100 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-a30dc218-c66b-46e9-83fa-3463bdd28da1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:50.881345 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-a30dc218-c66b-46e9-83fa-3463bdd28da1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:50.888722 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a30dc218-c66b-46e9-83fa-3463bdd28da1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:50.889361 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a30dc218-c66b-46e9-83fa-3463bdd28da1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:50.889802 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a30dc218-c66b-46e9-83fa-3463bdd28da1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:50.890503 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a30dc218-c66b-46e9-83fa-3463bdd28da1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:50.890985 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a30dc218-c66b-46e9-83fa-3463bdd28da1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:50.891414 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a30dc218-c66b-46e9-83fa-3463bdd28da1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:51.091466 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a30dc218-c66b-46e9-83fa-3463bdd28da1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:51.099248 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a30dc218-c66b-46e9-83fa-3463bdd28da1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:51.100747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a30dc218-c66b-46e9-83fa-3463bdd28da1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:51.102439 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-a30dc218-c66b-46e9-83fa-3463bdd28da1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.226337 Aug 09 18:19:51.103317 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 206/423] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:19:50 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:19:51.751029 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-305315e7-af98-493b-a9c4-1f57c5273817 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:51.751895 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-305315e7-af98-493b-a9c4-1f57c5273817 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:51.759939 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-305315e7-af98-493b-a9c4-1f57c5273817 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:51.760435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-305315e7-af98-493b-a9c4-1f57c5273817 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:51.760866 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-305315e7-af98-493b-a9c4-1f57c5273817 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:51.761550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-305315e7-af98-493b-a9c4-1f57c5273817 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:51.762002 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-305315e7-af98-493b-a9c4-1f57c5273817 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:51.762421 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-305315e7-af98-493b-a9c4-1f57c5273817 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:51.894533 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-305315e7-af98-493b-a9c4-1f57c5273817 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:51.903383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-305315e7-af98-493b-a9c4-1f57c5273817 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1273 microversion: 2.1 time: 0.156681 Aug 09 18:19:51.903955 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 218/424] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:51 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1273 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:52.125582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-cff578c7-cde0-4388-b40b-e4b9566b14ef tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:52.126118 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-cff578c7-cde0-4388-b40b-e4b9566b14ef tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:52.132753 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cff578c7-cde0-4388-b40b-e4b9566b14ef tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:52.133418 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cff578c7-cde0-4388-b40b-e4b9566b14ef tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:52.133857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cff578c7-cde0-4388-b40b-e4b9566b14ef tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:52.134534 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cff578c7-cde0-4388-b40b-e4b9566b14ef tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:52.135012 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cff578c7-cde0-4388-b40b-e4b9566b14ef tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:52.135432 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cff578c7-cde0-4388-b40b-e4b9566b14ef tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:52.266319 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-cff578c7-cde0-4388-b40b-e4b9566b14ef tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:52.275159 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-cff578c7-cde0-4388-b40b-e4b9566b14ef tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:52.279983 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-cff578c7-cde0-4388-b40b-e4b9566b14ef tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:52.279983 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-cff578c7-cde0-4388-b40b-e4b9566b14ef tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.156144 Aug 09 18:19:52.279983 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 207/425] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:19:52 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:19:52.925515 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-15e03088-e143-42eb-8356-d359c814e091 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:52.926103 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-15e03088-e143-42eb-8356-d359c814e091 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:52.933500 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-15e03088-e143-42eb-8356-d359c814e091 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:52.933991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-15e03088-e143-42eb-8356-d359c814e091 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:52.934430 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-15e03088-e143-42eb-8356-d359c814e091 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:52.935166 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-15e03088-e143-42eb-8356-d359c814e091 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:52.935628 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-15e03088-e143-42eb-8356-d359c814e091 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:52.936053 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-15e03088-e143-42eb-8356-d359c814e091 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:53.068033 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-15e03088-e143-42eb-8356-d359c814e091 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:53.076220 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-15e03088-e143-42eb-8356-d359c814e091 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1273 microversion: 2.1 time: 0.154583 Aug 09 18:19:53.076787 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 219/426] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:52 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1273 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:53.301333 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-582326b5-3662-444c-9321-c537b4d415df tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:53.301941 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-582326b5-3662-444c-9321-c537b4d415df tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:53.308988 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-582326b5-3662-444c-9321-c537b4d415df tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:53.309473 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-582326b5-3662-444c-9321-c537b4d415df tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:53.309910 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-582326b5-3662-444c-9321-c537b4d415df tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:53.310596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-582326b5-3662-444c-9321-c537b4d415df tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:53.311079 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-582326b5-3662-444c-9321-c537b4d415df tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:53.311509 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-582326b5-3662-444c-9321-c537b4d415df tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:53.437555 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-582326b5-3662-444c-9321-c537b4d415df tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:53.445457 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-582326b5-3662-444c-9321-c537b4d415df tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:53.446997 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-582326b5-3662-444c-9321-c537b4d415df tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:53.448148 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-582326b5-3662-444c-9321-c537b4d415df tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.150718 Aug 09 18:19:53.448699 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 208/427] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:19:53 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:19:54.097676 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a1a61d06-a82f-4f4f-9aae-9dab06fc1dab tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:54.098308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a1a61d06-a82f-4f4f-9aae-9dab06fc1dab tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:54.105012 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a1a61d06-a82f-4f4f-9aae-9dab06fc1dab tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:54.105502 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a1a61d06-a82f-4f4f-9aae-9dab06fc1dab tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:54.105936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a1a61d06-a82f-4f4f-9aae-9dab06fc1dab tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:54.106625 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a1a61d06-a82f-4f4f-9aae-9dab06fc1dab tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:54.107112 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a1a61d06-a82f-4f4f-9aae-9dab06fc1dab tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:54.107535 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a1a61d06-a82f-4f4f-9aae-9dab06fc1dab tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:54.292422 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a1a61d06-a82f-4f4f-9aae-9dab06fc1dab tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:54.299865 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a1a61d06-a82f-4f4f-9aae-9dab06fc1dab tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1273 microversion: 2.1 time: 0.206175 Aug 09 18:19:54.300425 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 220/428] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:54 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1273 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:54.471544 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-39ac41ae-cb90-4c44-b45c-d225817443e0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:54.472081 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-39ac41ae-cb90-4c44-b45c-d225817443e0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:54.479225 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-39ac41ae-cb90-4c44-b45c-d225817443e0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:54.479713 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-39ac41ae-cb90-4c44-b45c-d225817443e0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:54.480141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-39ac41ae-cb90-4c44-b45c-d225817443e0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:54.480840 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-39ac41ae-cb90-4c44-b45c-d225817443e0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:54.481294 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-39ac41ae-cb90-4c44-b45c-d225817443e0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:54.481772 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-39ac41ae-cb90-4c44-b45c-d225817443e0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:54.805205 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-39ac41ae-cb90-4c44-b45c-d225817443e0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:54.813566 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-39ac41ae-cb90-4c44-b45c-d225817443e0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:54.815238 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-39ac41ae-cb90-4c44-b45c-d225817443e0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:54.816399 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-39ac41ae-cb90-4c44-b45c-d225817443e0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.348881 Aug 09 18:19:54.816962 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 209/429] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:19:54 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:19:54.934581 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-411a9b80-7c63-4885-aca0-1ea85d663670 req-bc6e79e5-1e69-4ee8-b35f-e06daf57464a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4979ac5e-c9e0-4028-8bfe-e928f34a6bf0", "tag": "8911ba4a-f945-4b8b-9d28-626b00b2addb"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:19:54.944119 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-411a9b80-7c63-4885-aca0-1ea85d663670 req-bc6e79e5-1e69-4ee8-b35f-e06daf57464a service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:54.944597 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-411a9b80-7c63-4885-aca0-1ea85d663670 req-bc6e79e5-1e69-4ee8-b35f-e06daf57464a service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:54.945468 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-411a9b80-7c63-4885-aca0-1ea85d663670 req-bc6e79e5-1e69-4ee8-b35f-e06daf57464a service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:54.956268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-411a9b80-7c63-4885-aca0-1ea85d663670 req-bc6e79e5-1e69-4ee8-b35f-e06daf57464a service nova] Creating event network-changed:8911ba4a-f945-4b8b-9d28-626b00b2addb for instance 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 on hv-cinder-79797 Aug 09 18:19:54.962529 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-411a9b80-7c63-4885-aca0-1ea85d663670 req-bc6e79e5-1e69-4ee8-b35f-e06daf57464a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031372 Aug 09 18:19:54.963159 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 221/430] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:19:55.320689 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-34552bc9-21bf-4e73-85bb-3d24f58e9341 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:55.321352 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-34552bc9-21bf-4e73-85bb-3d24f58e9341 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:55.327949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-34552bc9-21bf-4e73-85bb-3d24f58e9341 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:55.328430 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-34552bc9-21bf-4e73-85bb-3d24f58e9341 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:55.328859 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-34552bc9-21bf-4e73-85bb-3d24f58e9341 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:55.329537 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-34552bc9-21bf-4e73-85bb-3d24f58e9341 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:55.329985 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-34552bc9-21bf-4e73-85bb-3d24f58e9341 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:55.330400 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-34552bc9-21bf-4e73-85bb-3d24f58e9341 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:55.510229 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-34552bc9-21bf-4e73-85bb-3d24f58e9341 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:55.517821 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-34552bc9-21bf-4e73-85bb-3d24f58e9341 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1273 microversion: 2.1 time: 0.201092 Aug 09 18:19:55.518427 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 210/431] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:55 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1273 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:55.836996 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=2 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:19:55.841119 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-74eb65b4-f19e-4010-b6ca-a3267a36d049 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:55.841811 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-74eb65b4-f19e-4010-b6ca-a3267a36d049 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:55.847859 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-74eb65b4-f19e-4010-b6ca-a3267a36d049 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:55.848337 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-74eb65b4-f19e-4010-b6ca-a3267a36d049 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:55.848765 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-74eb65b4-f19e-4010-b6ca-a3267a36d049 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:55.849452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-74eb65b4-f19e-4010-b6ca-a3267a36d049 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:55.849905 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-74eb65b4-f19e-4010-b6ca-a3267a36d049 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:55.850319 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-74eb65b4-f19e-4010-b6ca-a3267a36d049 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:56.065538 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-74eb65b4-f19e-4010-b6ca-a3267a36d049 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:56.074672 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-74eb65b4-f19e-4010-b6ca-a3267a36d049 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:56.076199 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-74eb65b4-f19e-4010-b6ca-a3267a36d049 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:56.077345 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-74eb65b4-f19e-4010-b6ca-a3267a36d049 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.241829 Aug 09 18:19:56.078097 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 222/432] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:19:55 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:19:56.540124 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-212b90b3-861e-4dd0-a35b-5885c99d4b3d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:56.540798 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-212b90b3-861e-4dd0-a35b-5885c99d4b3d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:56.547254 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-212b90b3-861e-4dd0-a35b-5885c99d4b3d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:56.547737 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-212b90b3-861e-4dd0-a35b-5885c99d4b3d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:56.548170 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-212b90b3-861e-4dd0-a35b-5885c99d4b3d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:56.548883 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-212b90b3-861e-4dd0-a35b-5885c99d4b3d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:56.549331 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-212b90b3-861e-4dd0-a35b-5885c99d4b3d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:56.549758 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-212b90b3-861e-4dd0-a35b-5885c99d4b3d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:56.685274 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-212b90b3-861e-4dd0-a35b-5885c99d4b3d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:56.692902 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-212b90b3-861e-4dd0-a35b-5885c99d4b3d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1273 microversion: 2.1 time: 0.157252 Aug 09 18:19:56.695359 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 211/433] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:56 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1273 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:57.099297 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6bc5f068-20bc-4f6b-ad9d-3770bc87eeb3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:57.099937 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-6bc5f068-20bc-4f6b-ad9d-3770bc87eeb3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:57.101909 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=8 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:19:57.107551 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6bc5f068-20bc-4f6b-ad9d-3770bc87eeb3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:57.107988 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6bc5f068-20bc-4f6b-ad9d-3770bc87eeb3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:57.108422 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6bc5f068-20bc-4f6b-ad9d-3770bc87eeb3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:57.109117 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6bc5f068-20bc-4f6b-ad9d-3770bc87eeb3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:57.109592 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6bc5f068-20bc-4f6b-ad9d-3770bc87eeb3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:57.110018 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6bc5f068-20bc-4f6b-ad9d-3770bc87eeb3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:57.242427 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6bc5f068-20bc-4f6b-ad9d-3770bc87eeb3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:57.250595 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6bc5f068-20bc-4f6b-ad9d-3770bc87eeb3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:57.252256 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6bc5f068-20bc-4f6b-ad9d-3770bc87eeb3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:57.253608 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-6bc5f068-20bc-4f6b-ad9d-3770bc87eeb3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.158013 Aug 09 18:19:57.254033 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 223/434] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:19:57 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:19:57.714516 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-830bbb9b-bd20-4667-8d63-5ca249bf4d63 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:57.715084 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-830bbb9b-bd20-4667-8d63-5ca249bf4d63 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:57.721427 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-830bbb9b-bd20-4667-8d63-5ca249bf4d63 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:57.721938 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-830bbb9b-bd20-4667-8d63-5ca249bf4d63 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:57.722376 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-830bbb9b-bd20-4667-8d63-5ca249bf4d63 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:57.723099 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-830bbb9b-bd20-4667-8d63-5ca249bf4d63 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:57.723554 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-830bbb9b-bd20-4667-8d63-5ca249bf4d63 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:57.723993 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-830bbb9b-bd20-4667-8d63-5ca249bf4d63 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:57.856461 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-830bbb9b-bd20-4667-8d63-5ca249bf4d63 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:57.864100 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-830bbb9b-bd20-4667-8d63-5ca249bf4d63 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1261 microversion: 2.1 time: 0.154545 Aug 09 18:19:57.864668 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 212/435] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:57 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:58.277491 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-73f7d8e3-a8e8-4229-85b6-37fb37b9dd49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:58.278097 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-73f7d8e3-a8e8-4229-85b6-37fb37b9dd49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:58.284873 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-73f7d8e3-a8e8-4229-85b6-37fb37b9dd49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:58.285355 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-73f7d8e3-a8e8-4229-85b6-37fb37b9dd49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:58.285795 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-73f7d8e3-a8e8-4229-85b6-37fb37b9dd49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:58.286475 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-73f7d8e3-a8e8-4229-85b6-37fb37b9dd49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:58.286963 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-73f7d8e3-a8e8-4229-85b6-37fb37b9dd49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:58.287389 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-73f7d8e3-a8e8-4229-85b6-37fb37b9dd49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:58.415187 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-73f7d8e3-a8e8-4229-85b6-37fb37b9dd49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:58.422996 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-73f7d8e3-a8e8-4229-85b6-37fb37b9dd49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:58.424502 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-73f7d8e3-a8e8-4229-85b6-37fb37b9dd49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:58.425644 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-73f7d8e3-a8e8-4229-85b6-37fb37b9dd49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.152784 Aug 09 18:19:58.426199 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 224/436] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:19:58 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:19:58.884955 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-dc70b1db-c23f-454f-b0d9-d2c1b4688420 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:58.886086 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-dc70b1db-c23f-454f-b0d9-d2c1b4688420 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:58.892589 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc70b1db-c23f-454f-b0d9-d2c1b4688420 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:58.893078 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc70b1db-c23f-454f-b0d9-d2c1b4688420 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:58.893515 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc70b1db-c23f-454f-b0d9-d2c1b4688420 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:58.894206 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc70b1db-c23f-454f-b0d9-d2c1b4688420 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:58.894664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc70b1db-c23f-454f-b0d9-d2c1b4688420 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:58.895116 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc70b1db-c23f-454f-b0d9-d2c1b4688420 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:59.027336 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-dc70b1db-c23f-454f-b0d9-d2c1b4688420 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:59.034558 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-dc70b1db-c23f-454f-b0d9-d2c1b4688420 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1261 microversion: 2.1 time: 0.153590 Aug 09 18:19:59.035145 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 213/437] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:58 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:59.448218 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-3e31f5a0-ae53-4bf4-a9fa-3efedc3559d8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:59.448828 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-3e31f5a0-ae53-4bf4-a9fa-3efedc3559d8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:59.455257 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3e31f5a0-ae53-4bf4-a9fa-3efedc3559d8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:59.455743 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3e31f5a0-ae53-4bf4-a9fa-3efedc3559d8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:59.456177 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3e31f5a0-ae53-4bf4-a9fa-3efedc3559d8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:59.456870 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3e31f5a0-ae53-4bf4-a9fa-3efedc3559d8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:59.457330 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3e31f5a0-ae53-4bf4-a9fa-3efedc3559d8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:59.457756 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3e31f5a0-ae53-4bf4-a9fa-3efedc3559d8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:59.587661 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-3e31f5a0-ae53-4bf4-a9fa-3efedc3559d8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:59.595435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-3e31f5a0-ae53-4bf4-a9fa-3efedc3559d8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:59.596942 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-3e31f5a0-ae53-4bf4-a9fa-3efedc3559d8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:59.598098 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-3e31f5a0-ae53-4bf4-a9fa-3efedc3559d8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.154034 Aug 09 18:19:59.598655 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 225/438] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:19:59 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:00.056144 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-538013c8-9705-44ff-a6c8-7d526708022a tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:00.056968 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-538013c8-9705-44ff-a6c8-7d526708022a tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:00.063524 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-538013c8-9705-44ff-a6c8-7d526708022a tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:00.064016 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-538013c8-9705-44ff-a6c8-7d526708022a tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:00.064451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-538013c8-9705-44ff-a6c8-7d526708022a tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:00.065139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-538013c8-9705-44ff-a6c8-7d526708022a tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:00.065596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-538013c8-9705-44ff-a6c8-7d526708022a tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:00.066035 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-538013c8-9705-44ff-a6c8-7d526708022a tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:00.197394 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-538013c8-9705-44ff-a6c8-7d526708022a tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:00.200980 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:20:00.205391 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-538013c8-9705-44ff-a6c8-7d526708022a tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1261 microversion: 2.1 time: 0.153214 Aug 09 18:20:00.205959 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 214/439] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:00 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:00.622516 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-729a6400-7e5f-49d0-b3b5-1349df0bf4f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:00.623256 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-729a6400-7e5f-49d0-b3b5-1349df0bf4f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:00.629865 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-729a6400-7e5f-49d0-b3b5-1349df0bf4f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:00.630352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-729a6400-7e5f-49d0-b3b5-1349df0bf4f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:00.630824 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-729a6400-7e5f-49d0-b3b5-1349df0bf4f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:00.631514 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-729a6400-7e5f-49d0-b3b5-1349df0bf4f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:00.631994 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-729a6400-7e5f-49d0-b3b5-1349df0bf4f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:00.632993 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-729a6400-7e5f-49d0-b3b5-1349df0bf4f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:00.763414 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-729a6400-7e5f-49d0-b3b5-1349df0bf4f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:00.771193 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-729a6400-7e5f-49d0-b3b5-1349df0bf4f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:00.772688 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-729a6400-7e5f-49d0-b3b5-1349df0bf4f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:00.773825 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-729a6400-7e5f-49d0-b3b5-1349df0bf4f1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.155290 Aug 09 18:20:00.774513 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 226/440] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:00 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:01.233179 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d1b76b9a-a767-48c8-9c92-2dd980d61edc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:01.233784 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d1b76b9a-a767-48c8-9c92-2dd980d61edc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:01.241047 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d1b76b9a-a767-48c8-9c92-2dd980d61edc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:01.241520 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d1b76b9a-a767-48c8-9c92-2dd980d61edc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:01.242067 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d1b76b9a-a767-48c8-9c92-2dd980d61edc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:01.242945 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d1b76b9a-a767-48c8-9c92-2dd980d61edc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:01.243398 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d1b76b9a-a767-48c8-9c92-2dd980d61edc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:01.243815 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d1b76b9a-a767-48c8-9c92-2dd980d61edc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:01.373634 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d1b76b9a-a767-48c8-9c92-2dd980d61edc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:01.381049 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d1b76b9a-a767-48c8-9c92-2dd980d61edc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1261 microversion: 2.1 time: 0.151658 Aug 09 18:20:01.381611 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 215/441] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:01 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:01.796090 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-20d421f2-95c8-4fd4-a540-67724742ce8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:01.796705 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-20d421f2-95c8-4fd4-a540-67724742ce8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:01.803139 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-20d421f2-95c8-4fd4-a540-67724742ce8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:01.803624 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-20d421f2-95c8-4fd4-a540-67724742ce8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:01.804062 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-20d421f2-95c8-4fd4-a540-67724742ce8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:01.805431 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-20d421f2-95c8-4fd4-a540-67724742ce8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:01.805953 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-20d421f2-95c8-4fd4-a540-67724742ce8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:01.806381 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-20d421f2-95c8-4fd4-a540-67724742ce8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:01.938910 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-20d421f2-95c8-4fd4-a540-67724742ce8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:01.947994 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-20d421f2-95c8-4fd4-a540-67724742ce8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:01.949517 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-20d421f2-95c8-4fd4-a540-67724742ce8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:01.950675 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-20d421f2-95c8-4fd4-a540-67724742ce8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.158550 Aug 09 18:20:01.951253 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 227/442] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:01 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:02.402166 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f24946f1-5b7b-4d03-9ce2-3c7cecd61b20 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:02.402797 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f24946f1-5b7b-4d03-9ce2-3c7cecd61b20 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:02.409135 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f24946f1-5b7b-4d03-9ce2-3c7cecd61b20 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:02.409611 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f24946f1-5b7b-4d03-9ce2-3c7cecd61b20 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:02.410038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f24946f1-5b7b-4d03-9ce2-3c7cecd61b20 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:02.410723 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f24946f1-5b7b-4d03-9ce2-3c7cecd61b20 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:02.411188 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f24946f1-5b7b-4d03-9ce2-3c7cecd61b20 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:02.411605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f24946f1-5b7b-4d03-9ce2-3c7cecd61b20 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:02.544737 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f24946f1-5b7b-4d03-9ce2-3c7cecd61b20 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:02.552300 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f24946f1-5b7b-4d03-9ce2-3c7cecd61b20 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1261 microversion: 2.1 time: 0.153983 Aug 09 18:20:02.552861 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 216/443] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:02 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:02.973644 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-bea510ea-4bd6-471c-a6b0-176aca548581 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:02.974247 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-bea510ea-4bd6-471c-a6b0-176aca548581 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:02.980742 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bea510ea-4bd6-471c-a6b0-176aca548581 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:02.981224 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bea510ea-4bd6-471c-a6b0-176aca548581 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:02.981655 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bea510ea-4bd6-471c-a6b0-176aca548581 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:02.982343 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bea510ea-4bd6-471c-a6b0-176aca548581 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:02.982820 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bea510ea-4bd6-471c-a6b0-176aca548581 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:02.983245 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bea510ea-4bd6-471c-a6b0-176aca548581 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:03.111900 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-bea510ea-4bd6-471c-a6b0-176aca548581 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:03.114080 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:20:03.120405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-bea510ea-4bd6-471c-a6b0-176aca548581 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:03.121919 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-bea510ea-4bd6-471c-a6b0-176aca548581 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:03.123110 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-bea510ea-4bd6-471c-a6b0-176aca548581 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.153379 Aug 09 18:20:03.123669 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 228/444] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:02 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:03.574417 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-91fde86d-c9cf-40ec-bf43-85c8733e6b79 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:03.575053 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-91fde86d-c9cf-40ec-bf43-85c8733e6b79 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:03.581577 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-91fde86d-c9cf-40ec-bf43-85c8733e6b79 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:03.582062 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-91fde86d-c9cf-40ec-bf43-85c8733e6b79 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:03.582497 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-91fde86d-c9cf-40ec-bf43-85c8733e6b79 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:03.583215 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-91fde86d-c9cf-40ec-bf43-85c8733e6b79 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:03.583671 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-91fde86d-c9cf-40ec-bf43-85c8733e6b79 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:03.584096 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-91fde86d-c9cf-40ec-bf43-85c8733e6b79 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:03.718725 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-91fde86d-c9cf-40ec-bf43-85c8733e6b79 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:03.726661 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-91fde86d-c9cf-40ec-bf43-85c8733e6b79 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1261 microversion: 2.1 time: 0.156476 Aug 09 18:20:03.727245 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 217/445] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:03 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:04.147236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6905d845-3c2e-4e03-a3fd-fe218a1bb6b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:04.148348 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-6905d845-3c2e-4e03-a3fd-fe218a1bb6b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:04.155248 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6905d845-3c2e-4e03-a3fd-fe218a1bb6b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:04.155728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6905d845-3c2e-4e03-a3fd-fe218a1bb6b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:04.156163 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6905d845-3c2e-4e03-a3fd-fe218a1bb6b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:04.156849 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6905d845-3c2e-4e03-a3fd-fe218a1bb6b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:04.157301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6905d845-3c2e-4e03-a3fd-fe218a1bb6b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:04.157723 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6905d845-3c2e-4e03-a3fd-fe218a1bb6b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:04.290516 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6905d845-3c2e-4e03-a3fd-fe218a1bb6b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:04.298456 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6905d845-3c2e-4e03-a3fd-fe218a1bb6b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:04.300022 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6905d845-3c2e-4e03-a3fd-fe218a1bb6b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:04.301173 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-6905d845-3c2e-4e03-a3fd-fe218a1bb6b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.158187 Aug 09 18:20:04.301730 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 229/446] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:04 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:04.747246 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-14f0f842-c223-4676-ab4c-5eaf8c2e8b17 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:04.747853 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-14f0f842-c223-4676-ab4c-5eaf8c2e8b17 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:04.754184 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-14f0f842-c223-4676-ab4c-5eaf8c2e8b17 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:04.754663 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-14f0f842-c223-4676-ab4c-5eaf8c2e8b17 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:04.755123 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-14f0f842-c223-4676-ab4c-5eaf8c2e8b17 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:04.755802 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-14f0f842-c223-4676-ab4c-5eaf8c2e8b17 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:04.756258 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-14f0f842-c223-4676-ab4c-5eaf8c2e8b17 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:04.756676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-14f0f842-c223-4676-ab4c-5eaf8c2e8b17 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:04.893220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-14f0f842-c223-4676-ab4c-5eaf8c2e8b17 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:04.900880 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-14f0f842-c223-4676-ab4c-5eaf8c2e8b17 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1261 microversion: 2.1 time: 0.157517 Aug 09 18:20:04.901444 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 218/447] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:04 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:05.324016 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-dead0596-8b18-45ba-80d9-682d4e43b39a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:05.324600 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-dead0596-8b18-45ba-80d9-682d4e43b39a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:05.330977 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dead0596-8b18-45ba-80d9-682d4e43b39a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:05.331453 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dead0596-8b18-45ba-80d9-682d4e43b39a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:05.331881 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dead0596-8b18-45ba-80d9-682d4e43b39a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:05.332561 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dead0596-8b18-45ba-80d9-682d4e43b39a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:05.333036 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dead0596-8b18-45ba-80d9-682d4e43b39a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:05.333458 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dead0596-8b18-45ba-80d9-682d4e43b39a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:05.463812 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-dead0596-8b18-45ba-80d9-682d4e43b39a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:05.471667 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-dead0596-8b18-45ba-80d9-682d4e43b39a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:05.473231 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-dead0596-8b18-45ba-80d9-682d4e43b39a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:05.474400 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-dead0596-8b18-45ba-80d9-682d4e43b39a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.154518 Aug 09 18:20:05.475017 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 230/448] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:05 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:05.921587 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-24c6c286-886c-47d6-8841-dd725522c09d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:05.922115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-24c6c286-886c-47d6-8841-dd725522c09d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:05.928352 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-24c6c286-886c-47d6-8841-dd725522c09d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:05.928832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-24c6c286-886c-47d6-8841-dd725522c09d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:05.929283 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-24c6c286-886c-47d6-8841-dd725522c09d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:05.929964 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-24c6c286-886c-47d6-8841-dd725522c09d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:05.930413 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-24c6c286-886c-47d6-8841-dd725522c09d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:05.930860 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-24c6c286-886c-47d6-8841-dd725522c09d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:06.066267 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-24c6c286-886c-47d6-8841-dd725522c09d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:06.074384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-24c6c286-886c-47d6-8841-dd725522c09d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1261 microversion: 2.1 time: 0.156786 Aug 09 18:20:06.074976 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 219/449] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:05 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:06.498361 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b5fa9984-b2ff-49bb-b5aa-28e2bc5c7705 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:06.499006 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-b5fa9984-b2ff-49bb-b5aa-28e2bc5c7705 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:06.505436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b5fa9984-b2ff-49bb-b5aa-28e2bc5c7705 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:06.505911 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b5fa9984-b2ff-49bb-b5aa-28e2bc5c7705 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:06.506340 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b5fa9984-b2ff-49bb-b5aa-28e2bc5c7705 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:06.507045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b5fa9984-b2ff-49bb-b5aa-28e2bc5c7705 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:06.508189 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b5fa9984-b2ff-49bb-b5aa-28e2bc5c7705 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:06.508812 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b5fa9984-b2ff-49bb-b5aa-28e2bc5c7705 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:06.640302 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b5fa9984-b2ff-49bb-b5aa-28e2bc5c7705 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:06.648205 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b5fa9984-b2ff-49bb-b5aa-28e2bc5c7705 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:06.649720 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b5fa9984-b2ff-49bb-b5aa-28e2bc5c7705 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:06.650923 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b5fa9984-b2ff-49bb-b5aa-28e2bc5c7705 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.156363 Aug 09 18:20:06.651807 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 231/450] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:06 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:07.095690 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-acd42126-c567-4d67-9335-47b135aa1f6e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:07.096303 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-acd42126-c567-4d67-9335-47b135aa1f6e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:07.103772 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-acd42126-c567-4d67-9335-47b135aa1f6e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:07.104382 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-acd42126-c567-4d67-9335-47b135aa1f6e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:07.104905 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-acd42126-c567-4d67-9335-47b135aa1f6e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:07.105592 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-acd42126-c567-4d67-9335-47b135aa1f6e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:07.106047 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-acd42126-c567-4d67-9335-47b135aa1f6e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:07.106468 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-acd42126-c567-4d67-9335-47b135aa1f6e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:07.240259 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-acd42126-c567-4d67-9335-47b135aa1f6e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:07.247828 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-acd42126-c567-4d67-9335-47b135aa1f6e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1261 microversion: 2.1 time: 0.156034 Aug 09 18:20:07.248396 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 220/451] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:07 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:07.673526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-35aacaf0-88b7-4e8e-b4e7-cf75d89e8e11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:07.674051 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-35aacaf0-88b7-4e8e-b4e7-cf75d89e8e11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:07.681352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-35aacaf0-88b7-4e8e-b4e7-cf75d89e8e11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:07.682212 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-35aacaf0-88b7-4e8e-b4e7-cf75d89e8e11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:07.682661 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-35aacaf0-88b7-4e8e-b4e7-cf75d89e8e11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:07.683397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-35aacaf0-88b7-4e8e-b4e7-cf75d89e8e11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:07.683852 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-35aacaf0-88b7-4e8e-b4e7-cf75d89e8e11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:07.684276 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-35aacaf0-88b7-4e8e-b4e7-cf75d89e8e11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:07.779916 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-4d5cf3dc-c015-427d-b2fc-819c5de5d427 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:07.780412 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-4d5cf3dc-c015-427d-b2fc-819c5de5d427 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:07.786203 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4d5cf3dc-c015-427d-b2fc-819c5de5d427 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:07.786679 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4d5cf3dc-c015-427d-b2fc-819c5de5d427 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:07.787142 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4d5cf3dc-c015-427d-b2fc-819c5de5d427 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:07.787818 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4d5cf3dc-c015-427d-b2fc-819c5de5d427 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:07.788262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4d5cf3dc-c015-427d-b2fc-819c5de5d427 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:07.788677 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4d5cf3dc-c015-427d-b2fc-819c5de5d427 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:07.819398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-35aacaf0-88b7-4e8e-b4e7-cf75d89e8e11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:07.827928 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-35aacaf0-88b7-4e8e-b4e7-cf75d89e8e11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:07.829431 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-35aacaf0-88b7-4e8e-b4e7-cf75d89e8e11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:07.830570 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-35aacaf0-88b7-4e8e-b4e7-cf75d89e8e11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.161004 Aug 09 18:20:07.831145 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 232/452] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:07 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:07.913806 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.objects.instance [None req-4d5cf3dc-c015-427d-b2fc-819c5de5d427 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lazy-loading 'services' on Instance uuid a38a4836-74e4-447e-a029-9a9f2fee6e4c {{(pid=118314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:20:08.173516 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-4d5cf3dc-c015-427d-b2fc-819c5de5d427 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c/os-volume_attachments/657f3d04-3e1b-4527-b278-09d755372bcc" status: 202 len: 0 microversion: 2.1 time: 0.397320 Aug 09 18:20:08.174157 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 221/453] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Aug 9 18:20:07 2022] DELETE /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c/os-volume_attachments/657f3d04-3e1b-4527-b278-09d755372bcc => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:20:08.269095 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-317c0766-c914-41a5-93ee-28d4922854af tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:08.269705 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-317c0766-c914-41a5-93ee-28d4922854af tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:08.276202 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-317c0766-c914-41a5-93ee-28d4922854af tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:08.276742 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-317c0766-c914-41a5-93ee-28d4922854af tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:08.277182 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-317c0766-c914-41a5-93ee-28d4922854af tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:08.277895 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-317c0766-c914-41a5-93ee-28d4922854af tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:08.278355 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-317c0766-c914-41a5-93ee-28d4922854af tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:08.278800 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-317c0766-c914-41a5-93ee-28d4922854af tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:08.423424 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-317c0766-c914-41a5-93ee-28d4922854af tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:08.431222 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-317c0766-c914-41a5-93ee-28d4922854af tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1261 microversion: 2.1 time: 0.166289 Aug 09 18:20:08.432134 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 233/454] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:08 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:08.855296 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-acf37d6c-c761-4570-a5e7-d3d656d0cb8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:08.855981 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-acf37d6c-c761-4570-a5e7-d3d656d0cb8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:08.862343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-acf37d6c-c761-4570-a5e7-d3d656d0cb8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:08.862850 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-acf37d6c-c761-4570-a5e7-d3d656d0cb8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:08.863286 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-acf37d6c-c761-4570-a5e7-d3d656d0cb8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:08.863976 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-acf37d6c-c761-4570-a5e7-d3d656d0cb8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:08.864430 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-acf37d6c-c761-4570-a5e7-d3d656d0cb8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:08.864859 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-acf37d6c-c761-4570-a5e7-d3d656d0cb8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:08.999583 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-acf37d6c-c761-4570-a5e7-d3d656d0cb8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:09.008276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-acf37d6c-c761-4570-a5e7-d3d656d0cb8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:09.010002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-acf37d6c-c761-4570-a5e7-d3d656d0cb8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:09.011195 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-acf37d6c-c761-4570-a5e7-d3d656d0cb8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.160945 Aug 09 18:20:09.011755 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 222/455] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:08 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:09.454769 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e9d74cd0-dd39-4301-aa98-4130b9a0ecbc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:09.455386 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e9d74cd0-dd39-4301-aa98-4130b9a0ecbc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:09.461900 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e9d74cd0-dd39-4301-aa98-4130b9a0ecbc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:09.462387 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e9d74cd0-dd39-4301-aa98-4130b9a0ecbc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:09.462849 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e9d74cd0-dd39-4301-aa98-4130b9a0ecbc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:09.463550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e9d74cd0-dd39-4301-aa98-4130b9a0ecbc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:09.464008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e9d74cd0-dd39-4301-aa98-4130b9a0ecbc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:09.464435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e9d74cd0-dd39-4301-aa98-4130b9a0ecbc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:09.594609 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e9d74cd0-dd39-4301-aa98-4130b9a0ecbc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:09.601982 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e9d74cd0-dd39-4301-aa98-4130b9a0ecbc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1261 microversion: 2.1 time: 0.151046 Aug 09 18:20:09.602535 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 234/456] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:09 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:10.034196 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-fdd12ed4-5671-4ec5-84b6-b38ae21ffb8a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:10.034855 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-fdd12ed4-5671-4ec5-84b6-b38ae21ffb8a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:10.041897 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fdd12ed4-5671-4ec5-84b6-b38ae21ffb8a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:10.042371 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fdd12ed4-5671-4ec5-84b6-b38ae21ffb8a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:10.042897 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fdd12ed4-5671-4ec5-84b6-b38ae21ffb8a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:10.043584 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fdd12ed4-5671-4ec5-84b6-b38ae21ffb8a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:10.044035 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fdd12ed4-5671-4ec5-84b6-b38ae21ffb8a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:10.044458 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fdd12ed4-5671-4ec5-84b6-b38ae21ffb8a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:10.175285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-fdd12ed4-5671-4ec5-84b6-b38ae21ffb8a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:10.183419 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-fdd12ed4-5671-4ec5-84b6-b38ae21ffb8a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:10.184908 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-fdd12ed4-5671-4ec5-84b6-b38ae21ffb8a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:10.186046 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-fdd12ed4-5671-4ec5-84b6-b38ae21ffb8a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.155752 Aug 09 18:20:10.186594 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 223/457] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:10 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:20:10.624063 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-4efca258-f2e5-42ea-994e-57b3a52673d6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:10.624645 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-4efca258-f2e5-42ea-994e-57b3a52673d6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:10.630510 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4efca258-f2e5-42ea-994e-57b3a52673d6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:10.631011 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4efca258-f2e5-42ea-994e-57b3a52673d6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:10.636872 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4efca258-f2e5-42ea-994e-57b3a52673d6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:10.636872 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4efca258-f2e5-42ea-994e-57b3a52673d6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:10.636872 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4efca258-f2e5-42ea-994e-57b3a52673d6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:10.636872 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4efca258-f2e5-42ea-994e-57b3a52673d6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:10.761952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4efca258-f2e5-42ea-994e-57b3a52673d6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:10.769305 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-4efca258-f2e5-42ea-994e-57b3a52673d6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1261 microversion: 2.1 time: 0.150290 Aug 09 18:20:10.769861 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 235/458] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:10 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:11.208418 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e8a5984e-8655-4cff-b841-f00c72171ae8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:11.209017 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e8a5984e-8655-4cff-b841-f00c72171ae8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:11.216079 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e8a5984e-8655-4cff-b841-f00c72171ae8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:11.216558 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e8a5984e-8655-4cff-b841-f00c72171ae8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:11.216989 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e8a5984e-8655-4cff-b841-f00c72171ae8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:11.217663 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e8a5984e-8655-4cff-b841-f00c72171ae8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:11.218112 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e8a5984e-8655-4cff-b841-f00c72171ae8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:11.218533 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e8a5984e-8655-4cff-b841-f00c72171ae8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:11.349217 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e8a5984e-8655-4cff-b841-f00c72171ae8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:11.359226 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e8a5984e-8655-4cff-b841-f00c72171ae8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:11.360614 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e8a5984e-8655-4cff-b841-f00c72171ae8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:11.362022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e8a5984e-8655-4cff-b841-f00c72171ae8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1746 microversion: 2.20 time: 0.157487 Aug 09 18:20:11.362553 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 224/459] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:11 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:11.424217 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-89f46cd0-25ac-409e-9253-acfeb93caf66 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:11.424971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-89f46cd0-25ac-409e-9253-acfeb93caf66 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:11.431510 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-89f46cd0-25ac-409e-9253-acfeb93caf66 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:11.432219 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-89f46cd0-25ac-409e-9253-acfeb93caf66 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:11.432790 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-89f46cd0-25ac-409e-9253-acfeb93caf66 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:11.433552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-89f46cd0-25ac-409e-9253-acfeb93caf66 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:11.434075 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-89f46cd0-25ac-409e-9253-acfeb93caf66 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:11.434503 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-89f46cd0-25ac-409e-9253-acfeb93caf66 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:11.464268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-89f46cd0-25ac-409e-9253-acfeb93caf66 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Going to try to terminate instance {{(pid=118313) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:20:11.790141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-919ae513-1059-4dd9-a625-739c9d83d262 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:11.790856 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-919ae513-1059-4dd9-a625-739c9d83d262 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:11.797060 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-919ae513-1059-4dd9-a625-739c9d83d262 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:11.797506 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-919ae513-1059-4dd9-a625-739c9d83d262 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:11.798055 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-919ae513-1059-4dd9-a625-739c9d83d262 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:11.798740 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-919ae513-1059-4dd9-a625-739c9d83d262 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:11.799166 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-919ae513-1059-4dd9-a625-739c9d83d262 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:11.799584 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-919ae513-1059-4dd9-a625-739c9d83d262 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:11.800221 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-89f46cd0-25ac-409e-9253-acfeb93caf66 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 204 len: 0 microversion: 2.1 time: 0.379502 Aug 09 18:20:11.801180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 236/460] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:20:11 2022] DELETE /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:20:11.818389 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-4f40aef1-9605-4c6b-8847-238145928a5b tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:11.819679 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-4f40aef1-9605-4c6b-8847-238145928a5b tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:11.826900 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4f40aef1-9605-4c6b-8847-238145928a5b tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:11.828159 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4f40aef1-9605-4c6b-8847-238145928a5b tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:11.828596 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4f40aef1-9605-4c6b-8847-238145928a5b tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:11.829302 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4f40aef1-9605-4c6b-8847-238145928a5b tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:11.829754 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4f40aef1-9605-4c6b-8847-238145928a5b tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:11.830613 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4f40aef1-9605-4c6b-8847-238145928a5b tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:12.006405 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-919ae513-1059-4dd9-a625-739c9d83d262 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:12.014073 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4f40aef1-9605-4c6b-8847-238145928a5b tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:12.014346 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-919ae513-1059-4dd9-a625-739c9d83d262 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1261 microversion: 2.1 time: 0.228672 Aug 09 18:20:12.014951 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 225/461] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:11 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1261 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:12.025324 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-4f40aef1-9605-4c6b-8847-238145928a5b tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1514 microversion: 2.1 time: 0.219427 Aug 09 18:20:12.026267 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 237/462] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:11 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1514 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:20:12.391673 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-a024b85b-f475-4b92-a65b-4914856511b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:12.392277 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-a024b85b-f475-4b92-a65b-4914856511b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:12.399312 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a024b85b-f475-4b92-a65b-4914856511b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:12.399737 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a024b85b-f475-4b92-a65b-4914856511b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:12.400169 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a024b85b-f475-4b92-a65b-4914856511b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:12.400854 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a024b85b-f475-4b92-a65b-4914856511b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:12.401302 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a024b85b-f475-4b92-a65b-4914856511b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:12.401718 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a024b85b-f475-4b92-a65b-4914856511b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:12.540067 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a024b85b-f475-4b92-a65b-4914856511b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:12.548356 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a024b85b-f475-4b92-a65b-4914856511b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:12.549877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a024b85b-f475-4b92-a65b-4914856511b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:12.551169 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-a024b85b-f475-4b92-a65b-4914856511b4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1746 microversion: 2.20 time: 0.163203 Aug 09 18:20:12.551729 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 226/463] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:12 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1746 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:13.035619 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e52fa67a-bd1e-4889-9974-19f37b90dd37 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:13.036227 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e52fa67a-bd1e-4889-9974-19f37b90dd37 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:13.043371 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e52fa67a-bd1e-4889-9974-19f37b90dd37 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:13.043884 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e52fa67a-bd1e-4889-9974-19f37b90dd37 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:13.044321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e52fa67a-bd1e-4889-9974-19f37b90dd37 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:13.045010 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e52fa67a-bd1e-4889-9974-19f37b90dd37 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:13.045465 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e52fa67a-bd1e-4889-9974-19f37b90dd37 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:13.045885 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e52fa67a-bd1e-4889-9974-19f37b90dd37 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:13.047002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d74b947d-7e5e-486f-a2ed-3eb05bb672cc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:13.047640 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d74b947d-7e5e-486f-a2ed-3eb05bb672cc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:13.053399 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d74b947d-7e5e-486f-a2ed-3eb05bb672cc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:13.053872 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d74b947d-7e5e-486f-a2ed-3eb05bb672cc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:13.054297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d74b947d-7e5e-486f-a2ed-3eb05bb672cc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:13.055008 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d74b947d-7e5e-486f-a2ed-3eb05bb672cc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:13.055465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d74b947d-7e5e-486f-a2ed-3eb05bb672cc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:13.056138 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d74b947d-7e5e-486f-a2ed-3eb05bb672cc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:13.245734 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e52fa67a-bd1e-4889-9974-19f37b90dd37 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:13.249114 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d74b947d-7e5e-486f-a2ed-3eb05bb672cc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:13.253202 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e52fa67a-bd1e-4889-9974-19f37b90dd37 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1261 microversion: 2.1 time: 0.221347 Aug 09 18:20:13.253771 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 238/464] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:13 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1261 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:13.256410 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d74b947d-7e5e-486f-a2ed-3eb05bb672cc tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1514 microversion: 2.1 time: 0.213140 Aug 09 18:20:13.256968 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 227/465] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:13 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1514 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:20:13.575629 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b7dda7bf-ce01-4a3c-85e6-311871b9b16d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:13.576231 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-b7dda7bf-ce01-4a3c-85e6-311871b9b16d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:13.582222 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b7dda7bf-ce01-4a3c-85e6-311871b9b16d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:13.582724 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b7dda7bf-ce01-4a3c-85e6-311871b9b16d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:13.583165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b7dda7bf-ce01-4a3c-85e6-311871b9b16d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:13.583841 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b7dda7bf-ce01-4a3c-85e6-311871b9b16d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:13.584291 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b7dda7bf-ce01-4a3c-85e6-311871b9b16d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:13.584709 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b7dda7bf-ce01-4a3c-85e6-311871b9b16d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:13.714340 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b7dda7bf-ce01-4a3c-85e6-311871b9b16d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:13.722682 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b7dda7bf-ce01-4a3c-85e6-311871b9b16d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:13.724319 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b7dda7bf-ce01-4a3c-85e6-311871b9b16d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:13.725524 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b7dda7bf-ce01-4a3c-85e6-311871b9b16d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1746 microversion: 2.20 time: 0.154804 Aug 09 18:20:13.726077 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 239/466] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:13 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:14.228197 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-47ceda40-e60e-4b82-8c8f-4b4823f01e0b req-3648a9ac-ba0c-43a8-8c33-f2b073cee5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97", "name": "network-vif-plugged", "status": "completed", "tag": "be3a4bfe-af09-41a6-9567-0b2aabb83ff4"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:20:14.239090 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-47ceda40-e60e-4b82-8c8f-4b4823f01e0b req-3648a9ac-ba0c-43a8-8c33-f2b073cee5d9 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:14.239643 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-47ceda40-e60e-4b82-8c8f-4b4823f01e0b req-3648a9ac-ba0c-43a8-8c33-f2b073cee5d9 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:14.240143 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-47ceda40-e60e-4b82-8c8f-4b4823f01e0b req-3648a9ac-ba0c-43a8-8c33-f2b073cee5d9 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:14.252527 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-47ceda40-e60e-4b82-8c8f-4b4823f01e0b req-3648a9ac-ba0c-43a8-8c33-f2b073cee5d9 service nova] Creating event network-vif-plugged:be3a4bfe-af09-41a6-9567-0b2aabb83ff4 for instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 on hv-cinder-79797 Aug 09 18:20:14.257407 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-47ceda40-e60e-4b82-8c8f-4b4823f01e0b req-3648a9ac-ba0c-43a8-8c33-f2b073cee5d9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033714 Aug 09 18:20:14.258002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 228/467] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:20:14.273417 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f506c37c-1af7-487a-986c-cd0a53307fef tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:14.275302 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f506c37c-1af7-487a-986c-cd0a53307fef tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:14.277693 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-85cf609c-8bd6-49c9-9ca9-6657c4ece704 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:14.278741 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-85cf609c-8bd6-49c9-9ca9-6657c4ece704 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:14.282088 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f506c37c-1af7-487a-986c-cd0a53307fef tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:14.282640 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f506c37c-1af7-487a-986c-cd0a53307fef tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:14.283109 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f506c37c-1af7-487a-986c-cd0a53307fef tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:14.283830 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f506c37c-1af7-487a-986c-cd0a53307fef tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:14.284289 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f506c37c-1af7-487a-986c-cd0a53307fef tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:14.284721 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f506c37c-1af7-487a-986c-cd0a53307fef tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:14.284859 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-85cf609c-8bd6-49c9-9ca9-6657c4ece704 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:14.285287 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-85cf609c-8bd6-49c9-9ca9-6657c4ece704 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:14.285722 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-85cf609c-8bd6-49c9-9ca9-6657c4ece704 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:14.286407 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-85cf609c-8bd6-49c9-9ca9-6657c4ece704 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:14.286897 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-85cf609c-8bd6-49c9-9ca9-6657c4ece704 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:14.287323 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-85cf609c-8bd6-49c9-9ca9-6657c4ece704 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:14.581214 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f506c37c-1af7-487a-986c-cd0a53307fef tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:14.590844 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f506c37c-1af7-487a-986c-cd0a53307fef tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1261 microversion: 2.1 time: 0.321214 Aug 09 18:20:14.603132 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 240/468] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:14 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1261 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:14.622402 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-85cf609c-8bd6-49c9-9ca9-6657c4ece704 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:14.630344 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-85cf609c-8bd6-49c9-9ca9-6657c4ece704 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1514 microversion: 2.1 time: 0.356974 Aug 09 18:20:14.630971 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 229/469] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:14 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1514 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:20:14.748657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-4b2e5ec6-cff8-4119-a472-038d3504b431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:14.749267 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-4b2e5ec6-cff8-4119-a472-038d3504b431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:14.755168 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4b2e5ec6-cff8-4119-a472-038d3504b431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:14.755664 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4b2e5ec6-cff8-4119-a472-038d3504b431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:14.756104 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4b2e5ec6-cff8-4119-a472-038d3504b431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:14.756794 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4b2e5ec6-cff8-4119-a472-038d3504b431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:14.757274 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4b2e5ec6-cff8-4119-a472-038d3504b431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:14.757675 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4b2e5ec6-cff8-4119-a472-038d3504b431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:14.962311 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-be26fd67-d4ae-4a62-9f01-336d233da449 req-a9b11b31-f865-489a-aa54-b37ba2424c46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a38a4836-74e4-447e-a029-9a9f2fee6e4c", "name": "network-vif-deleted", "tag": "8f2c0cc7-cb57-4dcd-af3a-a8fb648404a6"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:20:14.963009 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4b2e5ec6-cff8-4119-a472-038d3504b431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:14.971726 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4b2e5ec6-cff8-4119-a472-038d3504b431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:14.976494 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-be26fd67-d4ae-4a62-9f01-336d233da449 req-a9b11b31-f865-489a-aa54-b37ba2424c46 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:14.976494 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-be26fd67-d4ae-4a62-9f01-336d233da449 req-a9b11b31-f865-489a-aa54-b37ba2424c46 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:14.976494 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-be26fd67-d4ae-4a62-9f01-336d233da449 req-a9b11b31-f865-489a-aa54-b37ba2424c46 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:14.976808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4b2e5ec6-cff8-4119-a472-038d3504b431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:14.976808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-4b2e5ec6-cff8-4119-a472-038d3504b431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1746 microversion: 2.20 time: 0.229840 Aug 09 18:20:14.976808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 241/470] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:14 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1746 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:14.984577 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-be26fd67-d4ae-4a62-9f01-336d233da449 req-a9b11b31-f865-489a-aa54-b37ba2424c46 service nova] Creating event network-vif-deleted:8f2c0cc7-cb57-4dcd-af3a-a8fb648404a6 for instance a38a4836-74e4-447e-a029-9a9f2fee6e4c on hv-cinder-79797 Aug 09 18:20:14.993093 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-be26fd67-d4ae-4a62-9f01-336d233da449 req-a9b11b31-f865-489a-aa54-b37ba2424c46 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034556 Aug 09 18:20:14.994243 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 230/471] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:20:15.613912 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-8af05e3e-be37-417d-911f-ef7870a39d34 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:15.614521 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-8af05e3e-be37-417d-911f-ef7870a39d34 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:15.616959 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:20:15.621876 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8af05e3e-be37-417d-911f-ef7870a39d34 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:15.622364 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8af05e3e-be37-417d-911f-ef7870a39d34 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:15.622831 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8af05e3e-be37-417d-911f-ef7870a39d34 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:15.623527 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8af05e3e-be37-417d-911f-ef7870a39d34 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:15.623985 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8af05e3e-be37-417d-911f-ef7870a39d34 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:15.624413 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8af05e3e-be37-417d-911f-ef7870a39d34 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:15.653009 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-54b284ee-3c60-4f62-b4a6-910dcfa248fb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:15.653731 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-54b284ee-3c60-4f62-b4a6-910dcfa248fb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:15.660736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=63 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:20:15.660736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-54b284ee-3c60-4f62-b4a6-910dcfa248fb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:15.661112 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-54b284ee-3c60-4f62-b4a6-910dcfa248fb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:15.661487 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-54b284ee-3c60-4f62-b4a6-910dcfa248fb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:15.662177 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-54b284ee-3c60-4f62-b4a6-910dcfa248fb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:15.662634 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-54b284ee-3c60-4f62-b4a6-910dcfa248fb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:15.663127 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-54b284ee-3c60-4f62-b4a6-910dcfa248fb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:15.694959 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-54b284ee-3c60-4f62-b4a6-910dcfa248fb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:15.695559 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-54b284ee-3c60-4f62-b4a6-910dcfa248fb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:15.696534 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-54b284ee-3c60-4f62-b4a6-910dcfa248fb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:15.697174 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.objects.instance [None req-54b284ee-3c60-4f62-b4a6-910dcfa248fb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lazy-loading 'fault' on Instance uuid a38a4836-74e4-447e-a029-9a9f2fee6e4c {{(pid=118314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:20:15.752656 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-54b284ee-3c60-4f62-b4a6-910dcfa248fb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:15.756035 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:20:15.761361 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-54b284ee-3c60-4f62-b4a6-910dcfa248fb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 200 len: 1309 microversion: 2.1 time: 0.113532 Aug 09 18:20:15.762141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 231/472] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:15 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 1309 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:20:15.789880 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-8af05e3e-be37-417d-911f-ef7870a39d34 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:15.797272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-8af05e3e-be37-417d-911f-ef7870a39d34 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1261 microversion: 2.1 time: 0.187470 Aug 09 18:20:15.797830 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 242/473] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:15 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1261 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:15.998796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-232e44db-1fde-4ed6-ae65-5cca56bc43d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:16.002008 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-232e44db-1fde-4ed6-ae65-5cca56bc43d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:16.005818 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-232e44db-1fde-4ed6-ae65-5cca56bc43d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:16.006298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-232e44db-1fde-4ed6-ae65-5cca56bc43d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:16.006745 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-232e44db-1fde-4ed6-ae65-5cca56bc43d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:16.007418 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-232e44db-1fde-4ed6-ae65-5cca56bc43d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:16.007866 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-232e44db-1fde-4ed6-ae65-5cca56bc43d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:16.008281 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-232e44db-1fde-4ed6-ae65-5cca56bc43d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:16.143404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-232e44db-1fde-4ed6-ae65-5cca56bc43d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:16.152447 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-232e44db-1fde-4ed6-ae65-5cca56bc43d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:16.153969 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-232e44db-1fde-4ed6-ae65-5cca56bc43d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:16.155152 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-232e44db-1fde-4ed6-ae65-5cca56bc43d4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1746 microversion: 2.20 time: 0.160225 Aug 09 18:20:16.155714 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 232/474] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:15 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:20:16.271185 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-8afd7b28-bc4d-444d-8f6f-dc76a045b077 req-d8ea5f48-ca4f-425d-85b4-da15ee9557ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4979ac5e-c9e0-4028-8bfe-e928f34a6bf0", "name": "network-vif-plugged", "status": "completed", "tag": "8911ba4a-f945-4b8b-9d28-626b00b2addb"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:20:16.281402 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-8afd7b28-bc4d-444d-8f6f-dc76a045b077 req-d8ea5f48-ca4f-425d-85b4-da15ee9557ac service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:16.281875 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-8afd7b28-bc4d-444d-8f6f-dc76a045b077 req-d8ea5f48-ca4f-425d-85b4-da15ee9557ac service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:16.282336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-8afd7b28-bc4d-444d-8f6f-dc76a045b077 req-d8ea5f48-ca4f-425d-85b4-da15ee9557ac service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:16.293463 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-8afd7b28-bc4d-444d-8f6f-dc76a045b077 req-d8ea5f48-ca4f-425d-85b4-da15ee9557ac service nova] Creating event network-vif-plugged:8911ba4a-f945-4b8b-9d28-626b00b2addb for instance 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 on hv-cinder-79797 Aug 09 18:20:16.298283 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-8afd7b28-bc4d-444d-8f6f-dc76a045b077 req-d8ea5f48-ca4f-425d-85b4-da15ee9557ac service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030743 Aug 09 18:20:16.298881 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 243/475] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:20:16.783144 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d554d106-3c9f-4916-bc4b-7fc6d60d2b40 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:16.783763 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d554d106-3c9f-4916-bc4b-7fc6d60d2b40 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: a38a4836-74e4-447e-a029-9a9f2fee6e4c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:16.790033 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d554d106-3c9f-4916-bc4b-7fc6d60d2b40 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:16.790671 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d554d106-3c9f-4916-bc4b-7fc6d60d2b40 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:16.791140 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d554d106-3c9f-4916-bc4b-7fc6d60d2b40 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:16.791823 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d554d106-3c9f-4916-bc4b-7fc6d60d2b40 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:16.792278 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d554d106-3c9f-4916-bc4b-7fc6d60d2b40 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:16.792701 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d554d106-3c9f-4916-bc4b-7fc6d60d2b40 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:16.806417 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-d554d106-3c9f-4916-bc4b-7fc6d60d2b40 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] HTTP exception thrown: Instance a38a4836-74e4-447e-a029-9a9f2fee6e4c could not be found. Aug 09 18:20:16.808655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d554d106-3c9f-4916-bc4b-7fc6d60d2b40 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Request method failure captured: Aug 09 18:20:16.808655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c HTTP/1.1 Aug 09 18:20:16.808655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:20:16.808655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:20:16.808655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:20:16.808655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 0 Aug 09 18:20:16.808655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:20:16.808655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:20:16.808655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:20:16.808655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:20:16.808655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qTyhojQ4IRkT5cli773i0IR79YGnup16sqJn46SCZs3L1dT2IMl4aEnlRThvHHRBo5XXtykwlvBj_IYwVApLq_826aS01FsOglbG1M1ZkcDkHRjXggTTMjXEVneOAcjnOrJcz9nnLqMDGrMDUbXbWzT8hldf9KL-7DbdYBMYwYJGLI Aug 09 18:20:16.808655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:20:16.808655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:20:16.808655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:20:16.808655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:20:16.808655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:20:16.808655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:20:16.808655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: 1835c316b47c4cb08db14e0eb6e23c97 Aug 09 18:20:16.808655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1499154502 Aug 09 18:20:16.808655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:20:16.808655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:20:16.810037 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1835c316b47c4cb08db14e0eb6e23c97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1835c316b47c4cb08db14e0eb6e23c97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1835c316b47c4cb08db14e0eb6e23c97", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1835c316b47c4cb08db14e0eb6e23c97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:20:16.810037 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-VolumesSnapshotTestJSON-1499154502 Aug 09 18:20:16.810037 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: 1835c316b47c4cb08db14e0eb6e23c97 Aug 09 18:20:16.810037 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1499154502 Aug 09 18:20:16.810037 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-VolumesSnapshotTestJSON-1499154502-project Aug 09 18:20:16.810037 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:20:16.810037 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:20:16.810037 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: 6ee3fa12c3f448a9a419200051a02ab6 Aug 09 18:20:16.810037 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-VolumesSnapshotTestJSON-1499154502-project Aug 09 18:20:16.810037 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: > Aug 09 18:20:16.810037 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Instance a38a4836-74e4-447e-a029-9a9f2fee6e4c could not be found. Aug 09 18:20:16.810037 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'id': 'a38a4836-74e4-447e-a029-9a9f2fee6e4c'} Aug 09 18:20:16.810857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:20:16.810857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:20:16.810857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:20:16.810857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:20:16.810857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:20:16.810857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:20:16.810857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:20:16.810857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:20:16.810857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:20:16.810857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:20:16.810857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a38a4836-74e4-447e-a029-9a9f2fee6e4c could not be found. Aug 09 18:20:16.810857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:20:16.810857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:20:16.810857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:20:16.810857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:20:16.810857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:20:16.810857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:20:16.810857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:20:16.810857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:20:16.810857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:20:16.812460 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:20:16.812460 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:20:16.812460 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:20:16.812460 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:20:16.812460 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:20:16.812460 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:20:16.812460 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:20:16.812460 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a38a4836-74e4-447e-a029-9a9f2fee6e4c could not be found. Aug 09 18:20:16.812460 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:20:16.812460 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:20:16.812460 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:20:16.812460 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:20:16.812460 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:20:16.812460 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:20:16.812460 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:20:16.812460 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:20:16.812460 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a38a4836-74e4-447e-a029-9a9f2fee6e4c could not be found. Aug 09 18:20:16.812460 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:20:16.814333 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d554d106-3c9f-4916-bc4b-7fc6d60d2b40 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Returning 404 to user: Instance a38a4836-74e4-447e-a029-9a9f2fee6e4c could not be found. {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:20:16.814333 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d554d106-3c9f-4916-bc4b-7fc6d60d2b40 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c" status: 404 len: 111 microversion: 2.1 time: 0.030809 Aug 09 18:20:16.814333 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 233/476] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:16 2022] GET /compute/v2.1/servers/a38a4836-74e4-447e-a029-9a9f2fee6e4c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:20:16.820707 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-fdb51c13-456c-4e4d-89cb-b9150484ea31 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:16.822027 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-fdb51c13-456c-4e4d-89cb-b9150484ea31 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:16.828399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fdb51c13-456c-4e4d-89cb-b9150484ea31 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:16.832200 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fdb51c13-456c-4e4d-89cb-b9150484ea31 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:16.832200 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fdb51c13-456c-4e4d-89cb-b9150484ea31 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:16.832200 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fdb51c13-456c-4e4d-89cb-b9150484ea31 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:16.832200 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fdb51c13-456c-4e4d-89cb-b9150484ea31 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:16.832610 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fdb51c13-456c-4e4d-89cb-b9150484ea31 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:16.847392 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:20:16.972521 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-fdb51c13-456c-4e4d-89cb-b9150484ea31 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:16.979966 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-fdb51c13-456c-4e4d-89cb-b9150484ea31 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1261 microversion: 2.1 time: 0.164001 Aug 09 18:20:16.980540 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 244/477] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:16 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:17.178415 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8c4e8ce3-1d9e-43cb-bbf3-af5287d436bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:17.179370 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8c4e8ce3-1d9e-43cb-bbf3-af5287d436bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:17.188848 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c4e8ce3-1d9e-43cb-bbf3-af5287d436bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:17.189381 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c4e8ce3-1d9e-43cb-bbf3-af5287d436bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:17.189753 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c4e8ce3-1d9e-43cb-bbf3-af5287d436bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:17.190435 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c4e8ce3-1d9e-43cb-bbf3-af5287d436bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:17.191222 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c4e8ce3-1d9e-43cb-bbf3-af5287d436bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:17.191659 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c4e8ce3-1d9e-43cb-bbf3-af5287d436bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:17.326005 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8c4e8ce3-1d9e-43cb-bbf3-af5287d436bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:17.332837 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8c4e8ce3-1d9e-43cb-bbf3-af5287d436bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:17.334335 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8c4e8ce3-1d9e-43cb-bbf3-af5287d436bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:17.335506 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8c4e8ce3-1d9e-43cb-bbf3-af5287d436bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1746 microversion: 2.20 time: 0.160867 Aug 09 18:20:17.336055 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 234/478] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:17 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:18.001901 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-8f794c40-c3c3-4361-aebf-8fb16d33b96d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:18.002493 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-8f794c40-c3c3-4361-aebf-8fb16d33b96d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:18.010037 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8f794c40-c3c3-4361-aebf-8fb16d33b96d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:18.016656 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8f794c40-c3c3-4361-aebf-8fb16d33b96d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:18.016656 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8f794c40-c3c3-4361-aebf-8fb16d33b96d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:18.016656 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8f794c40-c3c3-4361-aebf-8fb16d33b96d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:18.016656 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8f794c40-c3c3-4361-aebf-8fb16d33b96d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:18.017037 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8f794c40-c3c3-4361-aebf-8fb16d33b96d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:18.145445 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-8f794c40-c3c3-4361-aebf-8fb16d33b96d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:18.153727 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-8f794c40-c3c3-4361-aebf-8fb16d33b96d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1261 microversion: 2.1 time: 0.155961 Aug 09 18:20:18.154305 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 245/479] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:17 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:18.359299 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-ed523638-be31-486e-acea-cb06b1f88b3d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:18.359821 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-ed523638-be31-486e-acea-cb06b1f88b3d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:18.366323 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ed523638-be31-486e-acea-cb06b1f88b3d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:18.366840 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ed523638-be31-486e-acea-cb06b1f88b3d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:18.367278 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ed523638-be31-486e-acea-cb06b1f88b3d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:18.368572 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ed523638-be31-486e-acea-cb06b1f88b3d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:18.369407 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ed523638-be31-486e-acea-cb06b1f88b3d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:18.369979 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ed523638-be31-486e-acea-cb06b1f88b3d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:18.502730 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-ed523638-be31-486e-acea-cb06b1f88b3d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:18.511644 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-ed523638-be31-486e-acea-cb06b1f88b3d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:18.513139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-ed523638-be31-486e-acea-cb06b1f88b3d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:18.519761 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-ed523638-be31-486e-acea-cb06b1f88b3d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1746 microversion: 2.20 time: 0.159039 Aug 09 18:20:18.519761 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 235/480] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:18 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:19.175084 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d63f05ba-eea2-4e22-9417-8f25f2dc709f tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:19.175685 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d63f05ba-eea2-4e22-9417-8f25f2dc709f tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:19.182485 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d63f05ba-eea2-4e22-9417-8f25f2dc709f tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:19.182993 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d63f05ba-eea2-4e22-9417-8f25f2dc709f tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:19.183421 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d63f05ba-eea2-4e22-9417-8f25f2dc709f tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:19.184097 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d63f05ba-eea2-4e22-9417-8f25f2dc709f tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:19.184546 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d63f05ba-eea2-4e22-9417-8f25f2dc709f tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:19.184969 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d63f05ba-eea2-4e22-9417-8f25f2dc709f tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:19.315540 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d63f05ba-eea2-4e22-9417-8f25f2dc709f tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:19.323343 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d63f05ba-eea2-4e22-9417-8f25f2dc709f tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1261 microversion: 2.1 time: 0.152121 Aug 09 18:20:19.323904 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 246/481] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:19 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:19.540600 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d15f419a-4984-4006-beed-f9c7de3da264 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:19.541194 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d15f419a-4984-4006-beed-f9c7de3da264 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:19.547573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d15f419a-4984-4006-beed-f9c7de3da264 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:19.548057 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d15f419a-4984-4006-beed-f9c7de3da264 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:19.548492 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d15f419a-4984-4006-beed-f9c7de3da264 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:19.549176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d15f419a-4984-4006-beed-f9c7de3da264 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:19.549634 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d15f419a-4984-4006-beed-f9c7de3da264 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:19.550057 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d15f419a-4984-4006-beed-f9c7de3da264 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:19.682226 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d15f419a-4984-4006-beed-f9c7de3da264 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:19.690055 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d15f419a-4984-4006-beed-f9c7de3da264 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:19.691593 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d15f419a-4984-4006-beed-f9c7de3da264 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:19.692740 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d15f419a-4984-4006-beed-f9c7de3da264 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1746 microversion: 2.20 time: 0.156075 Aug 09 18:20:19.693293 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 236/482] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:19 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:20.342843 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-821d6cee-1189-4f72-9c71-268f117d283c tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:20.343467 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-821d6cee-1189-4f72-9c71-268f117d283c tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:20.349816 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-821d6cee-1189-4f72-9c71-268f117d283c tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:20.350298 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-821d6cee-1189-4f72-9c71-268f117d283c tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:20.350755 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-821d6cee-1189-4f72-9c71-268f117d283c tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:20.351450 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-821d6cee-1189-4f72-9c71-268f117d283c tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:20.351900 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-821d6cee-1189-4f72-9c71-268f117d283c tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:20.352828 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-821d6cee-1189-4f72-9c71-268f117d283c tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:20.485193 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-821d6cee-1189-4f72-9c71-268f117d283c tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:20.493005 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-821d6cee-1189-4f72-9c71-268f117d283c tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1261 microversion: 2.1 time: 0.153950 Aug 09 18:20:20.494056 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 247/483] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:20 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:20.715901 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-2c7178f2-a8ea-4240-b3dc-3d867f5aae77 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:20.716471 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-2c7178f2-a8ea-4240-b3dc-3d867f5aae77 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:20.722647 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2c7178f2-a8ea-4240-b3dc-3d867f5aae77 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:20.723156 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2c7178f2-a8ea-4240-b3dc-3d867f5aae77 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:20.723584 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2c7178f2-a8ea-4240-b3dc-3d867f5aae77 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:20.724262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2c7178f2-a8ea-4240-b3dc-3d867f5aae77 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:20.725030 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2c7178f2-a8ea-4240-b3dc-3d867f5aae77 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:20.725131 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2c7178f2-a8ea-4240-b3dc-3d867f5aae77 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:21.012419 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-2c7178f2-a8ea-4240-b3dc-3d867f5aae77 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:21.020284 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-2c7178f2-a8ea-4240-b3dc-3d867f5aae77 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:21.021792 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-2c7178f2-a8ea-4240-b3dc-3d867f5aae77 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:21.022969 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-2c7178f2-a8ea-4240-b3dc-3d867f5aae77 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1746 microversion: 2.20 time: 0.311476 Aug 09 18:20:21.023517 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 237/484] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:20 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1746 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:21.514540 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b6119cb0-2acd-4498-a599-6c9156003484 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:21.515181 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-b6119cb0-2acd-4498-a599-6c9156003484 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:21.521643 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b6119cb0-2acd-4498-a599-6c9156003484 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:21.522134 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b6119cb0-2acd-4498-a599-6c9156003484 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:21.522576 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b6119cb0-2acd-4498-a599-6c9156003484 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:21.523303 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b6119cb0-2acd-4498-a599-6c9156003484 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:21.523763 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b6119cb0-2acd-4498-a599-6c9156003484 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:21.524197 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b6119cb0-2acd-4498-a599-6c9156003484 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:21.655436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b6119cb0-2acd-4498-a599-6c9156003484 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:21.663154 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b6119cb0-2acd-4498-a599-6c9156003484 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1261 microversion: 2.1 time: 0.152157 Aug 09 18:20:21.663721 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 248/485] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:21 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:22.047344 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-dc53b7f8-cf81-4a06-8a0b-ebf5dd0bb0e3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:22.048217 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-dc53b7f8-cf81-4a06-8a0b-ebf5dd0bb0e3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:22.055692 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc53b7f8-cf81-4a06-8a0b-ebf5dd0bb0e3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:22.056336 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc53b7f8-cf81-4a06-8a0b-ebf5dd0bb0e3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:22.056966 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc53b7f8-cf81-4a06-8a0b-ebf5dd0bb0e3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:22.058007 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc53b7f8-cf81-4a06-8a0b-ebf5dd0bb0e3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:22.058624 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc53b7f8-cf81-4a06-8a0b-ebf5dd0bb0e3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:22.059230 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc53b7f8-cf81-4a06-8a0b-ebf5dd0bb0e3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:22.193330 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-dc53b7f8-cf81-4a06-8a0b-ebf5dd0bb0e3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:22.202024 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-dc53b7f8-cf81-4a06-8a0b-ebf5dd0bb0e3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:22.203979 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-dc53b7f8-cf81-4a06-8a0b-ebf5dd0bb0e3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:22.205109 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-dc53b7f8-cf81-4a06-8a0b-ebf5dd0bb0e3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1746 microversion: 2.20 time: 0.162066 Aug 09 18:20:22.205663 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 238/486] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:22 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:22.684906 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-8d20369b-ea50-4301-959b-ca520bf85ba4 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:22.685516 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-8d20369b-ea50-4301-959b-ca520bf85ba4 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:22.692000 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8d20369b-ea50-4301-959b-ca520bf85ba4 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:22.692480 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8d20369b-ea50-4301-959b-ca520bf85ba4 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:22.692915 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8d20369b-ea50-4301-959b-ca520bf85ba4 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:22.693599 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8d20369b-ea50-4301-959b-ca520bf85ba4 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:22.694104 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8d20369b-ea50-4301-959b-ca520bf85ba4 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:22.694467 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8d20369b-ea50-4301-959b-ca520bf85ba4 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:22.885406 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-8d20369b-ea50-4301-959b-ca520bf85ba4 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:22.892957 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-8d20369b-ea50-4301-959b-ca520bf85ba4 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1445 microversion: 2.1 time: 0.212703 Aug 09 18:20:22.893524 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 249/487] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:22 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1445 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:22.914233 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-7b0282d5-5b6c-4842-8d6c-9ddcb3527050 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:22.915739 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-7b0282d5-5b6c-4842-8d6c-9ddcb3527050 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:22.921650 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7b0282d5-5b6c-4842-8d6c-9ddcb3527050 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:22.922126 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7b0282d5-5b6c-4842-8d6c-9ddcb3527050 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:22.922554 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7b0282d5-5b6c-4842-8d6c-9ddcb3527050 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:22.923266 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7b0282d5-5b6c-4842-8d6c-9ddcb3527050 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:22.923756 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7b0282d5-5b6c-4842-8d6c-9ddcb3527050 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:22.924168 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7b0282d5-5b6c-4842-8d6c-9ddcb3527050 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:23.063160 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-7b0282d5-5b6c-4842-8d6c-9ddcb3527050 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:23.070656 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-7b0282d5-5b6c-4842-8d6c-9ddcb3527050 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1445 microversion: 2.1 time: 0.160675 Aug 09 18:20:23.071510 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 239/488] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:22 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1445 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:23.230757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d062c139-fecd-4c9e-ace8-b1472169d885 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:23.231442 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d062c139-fecd-4c9e-ace8-b1472169d885 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:23.241562 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d062c139-fecd-4c9e-ace8-b1472169d885 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:23.242167 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d062c139-fecd-4c9e-ace8-b1472169d885 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:23.243888 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d062c139-fecd-4c9e-ace8-b1472169d885 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:23.244748 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d062c139-fecd-4c9e-ace8-b1472169d885 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:23.245275 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d062c139-fecd-4c9e-ace8-b1472169d885 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:23.245767 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d062c139-fecd-4c9e-ace8-b1472169d885 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:23.442894 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d062c139-fecd-4c9e-ace8-b1472169d885 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:23.452129 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d062c139-fecd-4c9e-ace8-b1472169d885 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:23.462824 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d062c139-fecd-4c9e-ace8-b1472169d885 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:23.465448 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d062c139-fecd-4c9e-ace8-b1472169d885 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1741 microversion: 2.20 time: 0.237664 Aug 09 18:20:23.467642 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 250/489] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:23 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1741 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:24.493994 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-664e8f14-3058-404e-9e35-50f35b62fefb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:24.494880 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-664e8f14-3058-404e-9e35-50f35b62fefb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:24.501801 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-664e8f14-3058-404e-9e35-50f35b62fefb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:24.502525 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-664e8f14-3058-404e-9e35-50f35b62fefb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:24.503160 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-664e8f14-3058-404e-9e35-50f35b62fefb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:24.504373 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-664e8f14-3058-404e-9e35-50f35b62fefb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:24.505115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-664e8f14-3058-404e-9e35-50f35b62fefb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:24.505697 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-664e8f14-3058-404e-9e35-50f35b62fefb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:24.724171 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-664e8f14-3058-404e-9e35-50f35b62fefb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:24.739333 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-664e8f14-3058-404e-9e35-50f35b62fefb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:24.741325 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-664e8f14-3058-404e-9e35-50f35b62fefb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:24.742663 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-664e8f14-3058-404e-9e35-50f35b62fefb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1741 microversion: 2.20 time: 0.253848 Aug 09 18:20:24.756144 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 240/490] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:24 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1741 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:25.767833 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e62bb533-2566-4da8-aef3-5fb7f8a7f263 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:25.770148 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e62bb533-2566-4da8-aef3-5fb7f8a7f263 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:25.777865 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e62bb533-2566-4da8-aef3-5fb7f8a7f263 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:25.778415 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e62bb533-2566-4da8-aef3-5fb7f8a7f263 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:25.778926 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e62bb533-2566-4da8-aef3-5fb7f8a7f263 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:25.779685 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e62bb533-2566-4da8-aef3-5fb7f8a7f263 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:25.780374 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e62bb533-2566-4da8-aef3-5fb7f8a7f263 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:25.781001 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e62bb533-2566-4da8-aef3-5fb7f8a7f263 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:25.968463 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-5c93ea69-1fc1-44c9-bcea-670daafb5ae0 req-e895ee15-4cf7-4093-96b5-1848102ddc10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4979ac5e-c9e0-4028-8bfe-e928f34a6bf0", "tag": "8911ba4a-f945-4b8b-9d28-626b00b2addb"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:20:25.982365 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-5c93ea69-1fc1-44c9-bcea-670daafb5ae0 req-e895ee15-4cf7-4093-96b5-1848102ddc10 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:25.983257 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-5c93ea69-1fc1-44c9-bcea-670daafb5ae0 req-e895ee15-4cf7-4093-96b5-1848102ddc10 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:25.983916 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-5c93ea69-1fc1-44c9-bcea-670daafb5ae0 req-e895ee15-4cf7-4093-96b5-1848102ddc10 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:25.997985 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-5c93ea69-1fc1-44c9-bcea-670daafb5ae0 req-e895ee15-4cf7-4093-96b5-1848102ddc10 service nova] Creating event network-changed:8911ba4a-f945-4b8b-9d28-626b00b2addb for instance 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 on hv-cinder-79797 Aug 09 18:20:26.003735 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-5c93ea69-1fc1-44c9-bcea-670daafb5ae0 req-e895ee15-4cf7-4093-96b5-1848102ddc10 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038976 Aug 09 18:20:26.004679 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 241/491] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:20:26.021521 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e62bb533-2566-4da8-aef3-5fb7f8a7f263 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:26.033425 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e62bb533-2566-4da8-aef3-5fb7f8a7f263 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:26.036194 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e62bb533-2566-4da8-aef3-5fb7f8a7f263 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:26.036992 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e62bb533-2566-4da8-aef3-5fb7f8a7f263 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1741 microversion: 2.20 time: 0.272608 Aug 09 18:20:26.037727 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 251/492] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:25 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1741 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:27.069690 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-3bc59aca-bd36-46fa-9f42-f3172d300bbf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:27.070409 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-3bc59aca-bd36-46fa-9f42-f3172d300bbf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:27.077307 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3bc59aca-bd36-46fa-9f42-f3172d300bbf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:27.077787 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3bc59aca-bd36-46fa-9f42-f3172d300bbf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:27.078217 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3bc59aca-bd36-46fa-9f42-f3172d300bbf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:27.078932 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3bc59aca-bd36-46fa-9f42-f3172d300bbf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:27.079383 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3bc59aca-bd36-46fa-9f42-f3172d300bbf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:27.079809 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3bc59aca-bd36-46fa-9f42-f3172d300bbf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:27.226413 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-3bc59aca-bd36-46fa-9f42-f3172d300bbf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:27.234381 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-3bc59aca-bd36-46fa-9f42-f3172d300bbf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:27.236189 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-3bc59aca-bd36-46fa-9f42-f3172d300bbf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:27.237338 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-3bc59aca-bd36-46fa-9f42-f3172d300bbf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1741 microversion: 2.20 time: 0.181013 Aug 09 18:20:27.237901 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 242/493] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:27 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:28.263722 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-99d204ec-086d-48be-845e-bdc6d2b38224 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:28.265047 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-99d204ec-086d-48be-845e-bdc6d2b38224 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:28.273400 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-99d204ec-086d-48be-845e-bdc6d2b38224 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:28.274144 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-99d204ec-086d-48be-845e-bdc6d2b38224 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:28.274795 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-99d204ec-086d-48be-845e-bdc6d2b38224 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:28.275734 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-99d204ec-086d-48be-845e-bdc6d2b38224 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:28.276347 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-99d204ec-086d-48be-845e-bdc6d2b38224 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:28.276925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-99d204ec-086d-48be-845e-bdc6d2b38224 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:28.449105 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-99d204ec-086d-48be-845e-bdc6d2b38224 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:28.467823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-99d204ec-086d-48be-845e-bdc6d2b38224 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:28.469811 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-99d204ec-086d-48be-845e-bdc6d2b38224 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:28.471298 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-99d204ec-086d-48be-845e-bdc6d2b38224 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1741 microversion: 2.20 time: 0.212003 Aug 09 18:20:28.486995 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 252/494] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:28 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1741 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:29.494752 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-15c67b56-c059-46e2-a231-4f6aa352af8f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:29.496245 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-15c67b56-c059-46e2-a231-4f6aa352af8f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:29.502784 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15c67b56-c059-46e2-a231-4f6aa352af8f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:29.503512 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15c67b56-c059-46e2-a231-4f6aa352af8f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:29.504184 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15c67b56-c059-46e2-a231-4f6aa352af8f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:29.504938 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15c67b56-c059-46e2-a231-4f6aa352af8f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:29.505457 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15c67b56-c059-46e2-a231-4f6aa352af8f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:29.506019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15c67b56-c059-46e2-a231-4f6aa352af8f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:29.741912 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-15c67b56-c059-46e2-a231-4f6aa352af8f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:29.751336 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-15c67b56-c059-46e2-a231-4f6aa352af8f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:29.753071 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-15c67b56-c059-46e2-a231-4f6aa352af8f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:29.754218 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-15c67b56-c059-46e2-a231-4f6aa352af8f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1741 microversion: 2.20 time: 0.264052 Aug 09 18:20:29.754784 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 243/495] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:29 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1741 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:30.499155 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-7e630d1c-4ce0-48d5-a7fd-ca730d13dc53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1100995637", "imageRef": "53732c26-c942-4646-ac3f-8d9e11ab4d57", "flavorRef": "452", "networks": [{"uuid": "b943d45b-08a6-4f8e-8c47-f0410b29ac1d"}]}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:20:30.553839 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.network.neutron [None req-7e630d1c-4ce0-48d5-a7fd-ca730d13dc53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] validate_networks() for [('b943d45b-08a6-4f8e-8c47-f0410b29ac1d', None, None, None, None, None)] {{(pid=118313) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:20:30.778159 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-ae3b3473-89ae-45b1-a661-2ee09c707621 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:30.778800 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-ae3b3473-89ae-45b1-a661-2ee09c707621 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:30.785204 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ae3b3473-89ae-45b1-a661-2ee09c707621 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:30.790945 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ae3b3473-89ae-45b1-a661-2ee09c707621 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:30.792410 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ae3b3473-89ae-45b1-a661-2ee09c707621 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:30.793141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ae3b3473-89ae-45b1-a661-2ee09c707621 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:30.793759 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ae3b3473-89ae-45b1-a661-2ee09c707621 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:30.794352 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ae3b3473-89ae-45b1-a661-2ee09c707621 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:31.031902 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-7e630d1c-4ce0-48d5-a7fd-ca730d13dc53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Flavor limits 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:20:31.032673 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-7e630d1c-4ce0-48d5-a7fd-ca730d13dc53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Image limits 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:20:31.033270 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-7e630d1c-4ce0-48d5-a7fd-ca730d13dc53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Flavor pref 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:20:31.033929 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-7e630d1c-4ce0-48d5-a7fd-ca730d13dc53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Image pref 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:20:31.034499 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-7e630d1c-4ce0-48d5-a7fd-ca730d13dc53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:20:31.047948 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-ae3b3473-89ae-45b1-a661-2ee09c707621 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:31.048549 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7e630d1c-4ce0-48d5-a7fd-ca730d13dc53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:31.049047 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7e630d1c-4ce0-48d5-a7fd-ca730d13dc53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:31.049484 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7e630d1c-4ce0-48d5-a7fd-ca730d13dc53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:31.050212 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7e630d1c-4ce0-48d5-a7fd-ca730d13dc53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:31.050833 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7e630d1c-4ce0-48d5-a7fd-ca730d13dc53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:31.051124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7e630d1c-4ce0-48d5-a7fd-ca730d13dc53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:31.058301 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-ae3b3473-89ae-45b1-a661-2ee09c707621 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:31.060435 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-ae3b3473-89ae-45b1-a661-2ee09c707621 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:31.061894 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-ae3b3473-89ae-45b1-a661-2ee09c707621 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1741 microversion: 2.20 time: 0.288352 Aug 09 18:20:31.069557 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-7e630d1c-4ce0-48d5-a7fd-ca730d13dc53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Getting quotas for project 1835c316b47c4cb08db14e0eb6e23c97. Resources: {'cores', 'instances', 'ram'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:20:31.074181 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-7e630d1c-4ce0-48d5-a7fd-ca730d13dc53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Getting quotas for user 6ee3fa12c3f448a9a419200051a02ab6 and project 1835c316b47c4cb08db14e0eb6e23c97. Resources: {'cores', 'instances', 'ram'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:20:31.075909 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 244/496] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:30 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1741 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:20:31.086280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-7e630d1c-4ce0-48d5-a7fd-ca730d13dc53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Going to run 1 instances... {{(pid=118313) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:20:31.088690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-7e630d1c-4ce0-48d5-a7fd-ca730d13dc53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: 5884512c-963f-44b6-aa8b-73f754017a43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53732c26-c942-4646-ac3f-8d9e11ab4d57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118313) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:20:31.199036 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-7e630d1c-4ce0-48d5-a7fd-ca730d13dc53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.703916 Aug 09 18:20:31.199591 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 253/497] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Aug 9 18:20:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:20:31.210198 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-7de890e5-2e39-4273-8f06-3be7ed941964 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:31.210832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-7de890e5-2e39-4273-8f06-3be7ed941964 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: 5884512c-963f-44b6-aa8b-73f754017a43] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:31.282911 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-7de890e5-2e39-4273-8f06-3be7ed941964 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:31.289917 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-7de890e5-2e39-4273-8f06-3be7ed941964 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43" status: 200 len: 1219 microversion: 2.1 time: 0.083540 Aug 09 18:20:31.290595 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 245/498] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:31 2022] GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:32.086868 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f6510060-fc29-49bc-ae9e-a89cc8195b52 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:32.087541 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f6510060-fc29-49bc-ae9e-a89cc8195b52 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:32.094616 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f6510060-fc29-49bc-ae9e-a89cc8195b52 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:32.095167 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f6510060-fc29-49bc-ae9e-a89cc8195b52 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:32.095605 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f6510060-fc29-49bc-ae9e-a89cc8195b52 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:32.096305 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f6510060-fc29-49bc-ae9e-a89cc8195b52 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:32.096887 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f6510060-fc29-49bc-ae9e-a89cc8195b52 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:32.097408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f6510060-fc29-49bc-ae9e-a89cc8195b52 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:32.263529 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f6510060-fc29-49bc-ae9e-a89cc8195b52 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:32.282837 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f6510060-fc29-49bc-ae9e-a89cc8195b52 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:32.284404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f6510060-fc29-49bc-ae9e-a89cc8195b52 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:32.285608 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f6510060-fc29-49bc-ae9e-a89cc8195b52 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1741 microversion: 2.20 time: 0.203431 Aug 09 18:20:32.286468 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 254/499] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:32 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:20:32.311632 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-2b7c89d4-e688-459d-b6b1-7ec7f02b417e tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:32.312248 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-2b7c89d4-e688-459d-b6b1-7ec7f02b417e tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: 5884512c-963f-44b6-aa8b-73f754017a43] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:32.319110 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2b7c89d4-e688-459d-b6b1-7ec7f02b417e tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:32.319671 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2b7c89d4-e688-459d-b6b1-7ec7f02b417e tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:32.320289 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2b7c89d4-e688-459d-b6b1-7ec7f02b417e tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:32.321040 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2b7c89d4-e688-459d-b6b1-7ec7f02b417e tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:32.321587 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2b7c89d4-e688-459d-b6b1-7ec7f02b417e tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:32.322192 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2b7c89d4-e688-459d-b6b1-7ec7f02b417e tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:32.395743 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-2b7c89d4-e688-459d-b6b1-7ec7f02b417e tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:32.404691 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-2b7c89d4-e688-459d-b6b1-7ec7f02b417e tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43" status: 200 len: 1223 microversion: 2.1 time: 0.096980 Aug 09 18:20:32.407458 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 246/500] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:32 2022] GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43 => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:33.309307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-986d5d26-9248-4109-b2d0-48fdd451ca15 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:33.309975 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-986d5d26-9248-4109-b2d0-48fdd451ca15 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:33.315999 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-986d5d26-9248-4109-b2d0-48fdd451ca15 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:33.316532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-986d5d26-9248-4109-b2d0-48fdd451ca15 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:33.316914 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-986d5d26-9248-4109-b2d0-48fdd451ca15 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:33.317603 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-986d5d26-9248-4109-b2d0-48fdd451ca15 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:33.318052 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-986d5d26-9248-4109-b2d0-48fdd451ca15 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:33.318470 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-986d5d26-9248-4109-b2d0-48fdd451ca15 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:33.427094 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-4898cca7-7538-4eb2-a560-8a505e0ac956 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:33.428886 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-4898cca7-7538-4eb2-a560-8a505e0ac956 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: 5884512c-963f-44b6-aa8b-73f754017a43] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:33.441322 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4898cca7-7538-4eb2-a560-8a505e0ac956 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:33.442192 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4898cca7-7538-4eb2-a560-8a505e0ac956 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:33.443106 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4898cca7-7538-4eb2-a560-8a505e0ac956 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:33.444123 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4898cca7-7538-4eb2-a560-8a505e0ac956 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:33.444867 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4898cca7-7538-4eb2-a560-8a505e0ac956 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:33.445526 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4898cca7-7538-4eb2-a560-8a505e0ac956 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:33.732054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-4898cca7-7538-4eb2-a560-8a505e0ac956 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:33.745620 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-4898cca7-7538-4eb2-a560-8a505e0ac956 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43" status: 200 len: 1279 microversion: 2.1 time: 0.321457 Aug 09 18:20:33.760161 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 247/501] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:33 2022] GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43 => generated 1279 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:33.923340 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-986d5d26-9248-4109-b2d0-48fdd451ca15 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:33.932804 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-986d5d26-9248-4109-b2d0-48fdd451ca15 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:33.934839 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-986d5d26-9248-4109-b2d0-48fdd451ca15 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:33.936018 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-986d5d26-9248-4109-b2d0-48fdd451ca15 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1741 microversion: 2.20 time: 0.631499 Aug 09 18:20:33.936747 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 255/502] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:33 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1741 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:34.768265 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-2e23aa40-b1ef-4219-b607-73f50964bf9a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:34.768889 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-2e23aa40-b1ef-4219-b607-73f50964bf9a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: 5884512c-963f-44b6-aa8b-73f754017a43] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:34.776284 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2e23aa40-b1ef-4219-b607-73f50964bf9a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:34.777007 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2e23aa40-b1ef-4219-b607-73f50964bf9a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:34.777650 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2e23aa40-b1ef-4219-b607-73f50964bf9a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:34.778540 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2e23aa40-b1ef-4219-b607-73f50964bf9a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:34.779200 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2e23aa40-b1ef-4219-b607-73f50964bf9a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:34.779802 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2e23aa40-b1ef-4219-b607-73f50964bf9a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:34.845212 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-2e23aa40-b1ef-4219-b607-73f50964bf9a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:34.852849 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-2e23aa40-b1ef-4219-b607-73f50964bf9a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43" status: 200 len: 1277 microversion: 2.1 time: 0.088454 Aug 09 18:20:34.853444 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 248/503] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:34 2022] GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43 => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:34.966611 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2cba6462-247e-42ae-ba20-fcbbca9cb11b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:34.967216 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-2cba6462-247e-42ae-ba20-fcbbca9cb11b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:34.974139 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2cba6462-247e-42ae-ba20-fcbbca9cb11b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:34.974620 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2cba6462-247e-42ae-ba20-fcbbca9cb11b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:34.975087 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2cba6462-247e-42ae-ba20-fcbbca9cb11b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:34.975771 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2cba6462-247e-42ae-ba20-fcbbca9cb11b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:34.976226 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2cba6462-247e-42ae-ba20-fcbbca9cb11b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:34.976652 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2cba6462-247e-42ae-ba20-fcbbca9cb11b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:35.174913 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-2cba6462-247e-42ae-ba20-fcbbca9cb11b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:35.192761 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-2cba6462-247e-42ae-ba20-fcbbca9cb11b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:35.194966 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-2cba6462-247e-42ae-ba20-fcbbca9cb11b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:35.196235 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-2cba6462-247e-42ae-ba20-fcbbca9cb11b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1741 microversion: 2.20 time: 0.234640 Aug 09 18:20:35.197063 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 256/504] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:34 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1741 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:35.874260 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e7b76520-5b4b-4fb8-b695-8049abff489f tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:35.875844 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e7b76520-5b4b-4fb8-b695-8049abff489f tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: 5884512c-963f-44b6-aa8b-73f754017a43] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:35.881419 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7b76520-5b4b-4fb8-b695-8049abff489f tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:35.882130 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7b76520-5b4b-4fb8-b695-8049abff489f tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:35.882639 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7b76520-5b4b-4fb8-b695-8049abff489f tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:35.883376 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7b76520-5b4b-4fb8-b695-8049abff489f tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:35.884314 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7b76520-5b4b-4fb8-b695-8049abff489f tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:35.884314 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7b76520-5b4b-4fb8-b695-8049abff489f tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:36.076863 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e7b76520-5b4b-4fb8-b695-8049abff489f tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:36.084745 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e7b76520-5b4b-4fb8-b695-8049abff489f tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43" status: 200 len: 1319 microversion: 2.1 time: 0.214432 Aug 09 18:20:36.085344 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 249/505] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:35 2022] GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:36.250352 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-dd2faa11-dd1d-47a0-8449-3a5e1369d500 req-a01a556d-ebc1-4d9c-bdc7-00baaa4bda2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5884512c-963f-44b6-aa8b-73f754017a43", "tag": "ebbe6f7e-a432-4386-8b97-4b471fce247f"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:20:36.261109 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-dd2faa11-dd1d-47a0-8449-3a5e1369d500 req-a01a556d-ebc1-4d9c-bdc7-00baaa4bda2f service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:36.265040 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-dd2faa11-dd1d-47a0-8449-3a5e1369d500 req-a01a556d-ebc1-4d9c-bdc7-00baaa4bda2f service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:36.265040 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-dd2faa11-dd1d-47a0-8449-3a5e1369d500 req-a01a556d-ebc1-4d9c-bdc7-00baaa4bda2f service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:36.277409 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-dd2faa11-dd1d-47a0-8449-3a5e1369d500 req-a01a556d-ebc1-4d9c-bdc7-00baaa4bda2f service nova] Creating event network-changed:ebbe6f7e-a432-4386-8b97-4b471fce247f for instance 5884512c-963f-44b6-aa8b-73f754017a43 on hv-cinder-79797 Aug 09 18:20:36.282620 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-dd2faa11-dd1d-47a0-8449-3a5e1369d500 req-a01a556d-ebc1-4d9c-bdc7-00baaa4bda2f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036394 Aug 09 18:20:36.283939 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 250/506] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:20:36.365582 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-10170553-521f-44e0-b300-3168606454bd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:36.366199 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-10170553-521f-44e0-b300-3168606454bd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:36.372541 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-10170553-521f-44e0-b300-3168606454bd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:36.373276 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-10170553-521f-44e0-b300-3168606454bd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:36.373714 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-10170553-521f-44e0-b300-3168606454bd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:36.374414 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-10170553-521f-44e0-b300-3168606454bd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:36.374903 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-10170553-521f-44e0-b300-3168606454bd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:36.375331 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-10170553-521f-44e0-b300-3168606454bd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:36.573810 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-10170553-521f-44e0-b300-3168606454bd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:36.581804 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-10170553-521f-44e0-b300-3168606454bd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:36.583411 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-10170553-521f-44e0-b300-3168606454bd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:36.584566 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-10170553-521f-44e0-b300-3168606454bd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1741 microversion: 2.20 time: 0.367079 Aug 09 18:20:36.585399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 257/507] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:36 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1741 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:37.106888 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-33325192-10d3-419d-83b4-f947a5a1c272 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:37.108034 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-33325192-10d3-419d-83b4-f947a5a1c272 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: 5884512c-963f-44b6-aa8b-73f754017a43] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:37.114073 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-33325192-10d3-419d-83b4-f947a5a1c272 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:37.114531 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-33325192-10d3-419d-83b4-f947a5a1c272 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:37.115114 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-33325192-10d3-419d-83b4-f947a5a1c272 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:37.115785 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-33325192-10d3-419d-83b4-f947a5a1c272 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:37.116241 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-33325192-10d3-419d-83b4-f947a5a1c272 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:37.116672 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-33325192-10d3-419d-83b4-f947a5a1c272 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:37.134595 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=100 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:20:37.248555 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-33325192-10d3-419d-83b4-f947a5a1c272 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:37.256070 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-33325192-10d3-419d-83b4-f947a5a1c272 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43" status: 200 len: 1319 microversion: 2.1 time: 0.154392 Aug 09 18:20:37.256628 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 251/508] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:37 2022] GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:37.607121 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-0ae3e2a1-9173-4ac1-94dd-3ec0de479b26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:37.607736 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-0ae3e2a1-9173-4ac1-94dd-3ec0de479b26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:37.614426 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0ae3e2a1-9173-4ac1-94dd-3ec0de479b26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:37.614943 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0ae3e2a1-9173-4ac1-94dd-3ec0de479b26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:37.615375 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0ae3e2a1-9173-4ac1-94dd-3ec0de479b26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:37.616059 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0ae3e2a1-9173-4ac1-94dd-3ec0de479b26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:37.616512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0ae3e2a1-9173-4ac1-94dd-3ec0de479b26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:37.616924 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0ae3e2a1-9173-4ac1-94dd-3ec0de479b26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:37.748648 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-0ae3e2a1-9173-4ac1-94dd-3ec0de479b26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:37.756547 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-0ae3e2a1-9173-4ac1-94dd-3ec0de479b26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:37.758061 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-0ae3e2a1-9173-4ac1-94dd-3ec0de479b26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:37.759263 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-0ae3e2a1-9173-4ac1-94dd-3ec0de479b26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1741 microversion: 2.20 time: 0.156792 Aug 09 18:20:37.759828 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 258/509] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:37 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1741 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:38.277158 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-62ee43d7-fe64-48dd-a8ac-82271a6b9333 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:38.277854 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-62ee43d7-fe64-48dd-a8ac-82271a6b9333 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: 5884512c-963f-44b6-aa8b-73f754017a43] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:38.284225 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-62ee43d7-fe64-48dd-a8ac-82271a6b9333 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:38.284708 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-62ee43d7-fe64-48dd-a8ac-82271a6b9333 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:38.285146 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-62ee43d7-fe64-48dd-a8ac-82271a6b9333 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:38.285835 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-62ee43d7-fe64-48dd-a8ac-82271a6b9333 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:38.286290 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-62ee43d7-fe64-48dd-a8ac-82271a6b9333 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:38.286732 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-62ee43d7-fe64-48dd-a8ac-82271a6b9333 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:38.412944 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-62ee43d7-fe64-48dd-a8ac-82271a6b9333 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:38.420759 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-62ee43d7-fe64-48dd-a8ac-82271a6b9333 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43" status: 200 len: 1319 microversion: 2.1 time: 0.148075 Aug 09 18:20:38.421336 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 252/510] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:38 2022] GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:38.783279 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-7e979b24-5fe7-43f6-94cb-1141c9175250 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:38.783890 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-7e979b24-5fe7-43f6-94cb-1141c9175250 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:38.790233 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7e979b24-5fe7-43f6-94cb-1141c9175250 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:38.790729 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7e979b24-5fe7-43f6-94cb-1141c9175250 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:38.791187 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7e979b24-5fe7-43f6-94cb-1141c9175250 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:38.791873 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7e979b24-5fe7-43f6-94cb-1141c9175250 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:38.792847 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7e979b24-5fe7-43f6-94cb-1141c9175250 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:38.793425 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7e979b24-5fe7-43f6-94cb-1141c9175250 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:38.925049 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-7e979b24-5fe7-43f6-94cb-1141c9175250 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:38.932913 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-7e979b24-5fe7-43f6-94cb-1141c9175250 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:38.934428 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-7e979b24-5fe7-43f6-94cb-1141c9175250 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:38.935645 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-7e979b24-5fe7-43f6-94cb-1141c9175250 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1741 microversion: 2.20 time: 0.157349 Aug 09 18:20:38.936202 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 259/511] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:38 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1741 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:39.441199 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-aff8d350-5072-4089-ab58-5b3ee41351cb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:39.441801 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-aff8d350-5072-4089-ab58-5b3ee41351cb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: 5884512c-963f-44b6-aa8b-73f754017a43] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:39.448178 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aff8d350-5072-4089-ab58-5b3ee41351cb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:39.449595 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aff8d350-5072-4089-ab58-5b3ee41351cb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:39.450033 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aff8d350-5072-4089-ab58-5b3ee41351cb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:39.450732 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aff8d350-5072-4089-ab58-5b3ee41351cb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:39.451218 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aff8d350-5072-4089-ab58-5b3ee41351cb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:39.451638 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aff8d350-5072-4089-ab58-5b3ee41351cb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:39.579969 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-aff8d350-5072-4089-ab58-5b3ee41351cb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:39.587253 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-aff8d350-5072-4089-ab58-5b3ee41351cb tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43" status: 200 len: 1319 microversion: 2.1 time: 0.149811 Aug 09 18:20:39.587817 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 253/512] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:39 2022] GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:39.957394 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-1259c33c-b213-428b-85a3-1ff0e51d8d11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:39.958014 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-1259c33c-b213-428b-85a3-1ff0e51d8d11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:39.965272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1259c33c-b213-428b-85a3-1ff0e51d8d11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:39.965759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1259c33c-b213-428b-85a3-1ff0e51d8d11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:39.966198 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1259c33c-b213-428b-85a3-1ff0e51d8d11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:39.966922 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1259c33c-b213-428b-85a3-1ff0e51d8d11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:39.967380 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1259c33c-b213-428b-85a3-1ff0e51d8d11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:39.967809 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1259c33c-b213-428b-85a3-1ff0e51d8d11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:40.094569 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-1259c33c-b213-428b-85a3-1ff0e51d8d11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:40.102393 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-1259c33c-b213-428b-85a3-1ff0e51d8d11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:40.103925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-1259c33c-b213-428b-85a3-1ff0e51d8d11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:40.105072 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-1259c33c-b213-428b-85a3-1ff0e51d8d11 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1741 microversion: 2.20 time: 0.151596 Aug 09 18:20:40.105622 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 260/513] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:39 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1741 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:40.608659 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-fd484fee-a468-4a05-a1da-5f1173202628 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:40.609267 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-fd484fee-a468-4a05-a1da-5f1173202628 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: 5884512c-963f-44b6-aa8b-73f754017a43] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:40.616224 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fd484fee-a468-4a05-a1da-5f1173202628 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:40.616708 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fd484fee-a468-4a05-a1da-5f1173202628 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:40.617139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fd484fee-a468-4a05-a1da-5f1173202628 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:40.617829 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fd484fee-a468-4a05-a1da-5f1173202628 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:40.618277 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fd484fee-a468-4a05-a1da-5f1173202628 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:40.618696 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fd484fee-a468-4a05-a1da-5f1173202628 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:40.816402 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-fd484fee-a468-4a05-a1da-5f1173202628 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:40.824803 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-fd484fee-a468-4a05-a1da-5f1173202628 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43" status: 200 len: 1319 microversion: 2.1 time: 0.220626 Aug 09 18:20:40.825383 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 254/514] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:40 2022] GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:41.128178 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b0923bde-b171-4c86-b020-9f7095c8070a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:41.128781 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-b0923bde-b171-4c86-b020-9f7095c8070a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:41.131108 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=2 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:20:41.131908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=6 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:20:41.136887 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b0923bde-b171-4c86-b020-9f7095c8070a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:41.141262 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b0923bde-b171-4c86-b020-9f7095c8070a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:41.141262 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b0923bde-b171-4c86-b020-9f7095c8070a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:41.141262 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b0923bde-b171-4c86-b020-9f7095c8070a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:41.141262 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b0923bde-b171-4c86-b020-9f7095c8070a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:41.141684 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b0923bde-b171-4c86-b020-9f7095c8070a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:41.269111 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b0923bde-b171-4c86-b020-9f7095c8070a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:41.271335 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=100 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:20:41.278217 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b0923bde-b171-4c86-b020-9f7095c8070a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:41.279747 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b0923bde-b171-4c86-b020-9f7095c8070a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:41.280898 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b0923bde-b171-4c86-b020-9f7095c8070a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1723 microversion: 2.20 time: 0.156665 Aug 09 18:20:41.281455 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 261/515] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:41 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:41.845580 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8007be65-cd12-4100-a076-5ffebda23a7a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:41.846190 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8007be65-cd12-4100-a076-5ffebda23a7a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: 5884512c-963f-44b6-aa8b-73f754017a43] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:41.848023 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=2 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:20:41.853172 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8007be65-cd12-4100-a076-5ffebda23a7a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:41.853653 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8007be65-cd12-4100-a076-5ffebda23a7a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:41.854086 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8007be65-cd12-4100-a076-5ffebda23a7a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:41.855464 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8007be65-cd12-4100-a076-5ffebda23a7a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:41.856133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8007be65-cd12-4100-a076-5ffebda23a7a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:41.856557 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8007be65-cd12-4100-a076-5ffebda23a7a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:41.988165 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8007be65-cd12-4100-a076-5ffebda23a7a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:41.996026 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8007be65-cd12-4100-a076-5ffebda23a7a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43" status: 200 len: 1319 microversion: 2.1 time: 0.154289 Aug 09 18:20:41.996591 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 255/516] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:41 2022] GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:42.309499 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5df8017d-9bb0-433b-900d-5930d02f5335 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:42.310188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-5df8017d-9bb0-433b-900d-5930d02f5335 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:42.317030 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5df8017d-9bb0-433b-900d-5930d02f5335 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:42.317522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5df8017d-9bb0-433b-900d-5930d02f5335 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:42.317961 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5df8017d-9bb0-433b-900d-5930d02f5335 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:42.318661 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5df8017d-9bb0-433b-900d-5930d02f5335 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:42.319140 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5df8017d-9bb0-433b-900d-5930d02f5335 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:42.319570 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5df8017d-9bb0-433b-900d-5930d02f5335 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:42.405285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-b665fdc2-37e0-4256-b0b5-3b35cb217c11 req-46d9b5d0-e7ea-4dbf-b053-473f09bcbf7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5884512c-963f-44b6-aa8b-73f754017a43", "name": "network-vif-plugged", "status": "completed", "tag": "ebbe6f7e-a432-4386-8b97-4b471fce247f"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:20:42.413809 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-b665fdc2-37e0-4256-b0b5-3b35cb217c11 req-46d9b5d0-e7ea-4dbf-b053-473f09bcbf7d service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:42.414285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-b665fdc2-37e0-4256-b0b5-3b35cb217c11 req-46d9b5d0-e7ea-4dbf-b053-473f09bcbf7d service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:42.414728 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-b665fdc2-37e0-4256-b0b5-3b35cb217c11 req-46d9b5d0-e7ea-4dbf-b053-473f09bcbf7d service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:42.425963 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-b665fdc2-37e0-4256-b0b5-3b35cb217c11 req-46d9b5d0-e7ea-4dbf-b053-473f09bcbf7d service nova] Creating event network-vif-plugged:ebbe6f7e-a432-4386-8b97-4b471fce247f for instance 5884512c-963f-44b6-aa8b-73f754017a43 on hv-cinder-79797 Aug 09 18:20:42.430937 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-b665fdc2-37e0-4256-b0b5-3b35cb217c11 req-46d9b5d0-e7ea-4dbf-b053-473f09bcbf7d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032583 Aug 09 18:20:42.436340 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 256/517] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:20:42.452992 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-5df8017d-9bb0-433b-900d-5930d02f5335 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:42.460974 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-5df8017d-9bb0-433b-900d-5930d02f5335 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:42.462645 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-5df8017d-9bb0-433b-900d-5930d02f5335 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:42.464977 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-5df8017d-9bb0-433b-900d-5930d02f5335 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1723 microversion: 2.20 time: 0.158657 Aug 09 18:20:42.465148 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 262/518] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:42 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:43.018156 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-78e3d842-ba92-4cb9-86a2-cfcab58fd03a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:43.018871 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-78e3d842-ba92-4cb9-86a2-cfcab58fd03a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: 5884512c-963f-44b6-aa8b-73f754017a43] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:43.025231 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-78e3d842-ba92-4cb9-86a2-cfcab58fd03a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:43.025714 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-78e3d842-ba92-4cb9-86a2-cfcab58fd03a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:43.026140 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-78e3d842-ba92-4cb9-86a2-cfcab58fd03a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:43.028017 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-78e3d842-ba92-4cb9-86a2-cfcab58fd03a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:43.028580 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-78e3d842-ba92-4cb9-86a2-cfcab58fd03a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:43.028940 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-78e3d842-ba92-4cb9-86a2-cfcab58fd03a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:43.160885 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-78e3d842-ba92-4cb9-86a2-cfcab58fd03a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:43.168645 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-78e3d842-ba92-4cb9-86a2-cfcab58fd03a tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43" status: 200 len: 1319 microversion: 2.1 time: 0.155267 Aug 09 18:20:43.169210 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 257/519] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:43 2022] GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:43.487066 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-86e5ac43-02b6-4af3-a526-a71bdf549ecc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:43.487670 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-86e5ac43-02b6-4af3-a526-a71bdf549ecc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:43.494277 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-86e5ac43-02b6-4af3-a526-a71bdf549ecc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:43.494785 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-86e5ac43-02b6-4af3-a526-a71bdf549ecc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:43.495895 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-86e5ac43-02b6-4af3-a526-a71bdf549ecc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:43.496635 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-86e5ac43-02b6-4af3-a526-a71bdf549ecc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:43.497122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-86e5ac43-02b6-4af3-a526-a71bdf549ecc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:43.497549 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-86e5ac43-02b6-4af3-a526-a71bdf549ecc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:43.629726 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-86e5ac43-02b6-4af3-a526-a71bdf549ecc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:43.638944 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-86e5ac43-02b6-4af3-a526-a71bdf549ecc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:43.640535 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-86e5ac43-02b6-4af3-a526-a71bdf549ecc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:43.641675 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-86e5ac43-02b6-4af3-a526-a71bdf549ecc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1726 microversion: 2.20 time: 0.158797 Aug 09 18:20:43.642226 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 263/520] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:43 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:43.663408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-765afe4d-e7d1-466d-8158-7620efc6b28a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8cb1f92-cbd3-453d-9bcd-b2824ece0658"}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:20:43.665842 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-765afe4d-e7d1-466d-8158-7620efc6b28a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:43.672209 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-765afe4d-e7d1-466d-8158-7620efc6b28a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:43.672774 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-765afe4d-e7d1-466d-8158-7620efc6b28a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:43.673276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-765afe4d-e7d1-466d-8158-7620efc6b28a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:43.674035 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-765afe4d-e7d1-466d-8158-7620efc6b28a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:43.674596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-765afe4d-e7d1-466d-8158-7620efc6b28a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:43.675110 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-765afe4d-e7d1-466d-8158-7620efc6b28a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:44.188944 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b3cc8e71-0c72-4ccf-b872-849f85174109 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:44.189588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-b3cc8e71-0c72-4ccf-b872-849f85174109 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: 5884512c-963f-44b6-aa8b-73f754017a43] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:44.195555 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b3cc8e71-0c72-4ccf-b872-849f85174109 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:44.196047 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b3cc8e71-0c72-4ccf-b872-849f85174109 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:44.196484 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b3cc8e71-0c72-4ccf-b872-849f85174109 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:44.197172 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b3cc8e71-0c72-4ccf-b872-849f85174109 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:44.197633 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b3cc8e71-0c72-4ccf-b872-849f85174109 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:44.198055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b3cc8e71-0c72-4ccf-b872-849f85174109 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:44.331547 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b3cc8e71-0c72-4ccf-b872-849f85174109 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:44.338875 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b3cc8e71-0c72-4ccf-b872-849f85174109 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43" status: 200 len: 1319 microversion: 2.1 time: 0.153815 Aug 09 18:20:44.339438 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 264/521] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:44 2022] GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:44.445236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-afe31376-06f0-48e4-8829-dc3118dc7d4f req-13c0b732-82f4-4217-ae63-865c9b1c99ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97", "name": "network-vif-unplugged", "status": "completed", "tag": "be3a4bfe-af09-41a6-9567-0b2aabb83ff4"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:20:44.455309 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-afe31376-06f0-48e4-8829-dc3118dc7d4f req-13c0b732-82f4-4217-ae63-865c9b1c99ba service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:44.455793 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-afe31376-06f0-48e4-8829-dc3118dc7d4f req-13c0b732-82f4-4217-ae63-865c9b1c99ba service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:44.456221 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-afe31376-06f0-48e4-8829-dc3118dc7d4f req-13c0b732-82f4-4217-ae63-865c9b1c99ba service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:44.469378 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-afe31376-06f0-48e4-8829-dc3118dc7d4f req-13c0b732-82f4-4217-ae63-865c9b1c99ba service nova] Creating event network-vif-unplugged:be3a4bfe-af09-41a6-9567-0b2aabb83ff4 for instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 on hv-cinder-79797 Aug 09 18:20:44.474500 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-afe31376-06f0-48e4-8829-dc3118dc7d4f req-13c0b732-82f4-4217-ae63-865c9b1c99ba service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032803 Aug 09 18:20:44.475383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 265/522] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:20:44.539194 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-765afe4d-e7d1-466d-8158-7620efc6b28a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "POST /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.879651 Aug 09 18:20:44.539808 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 258/523] 10.222.0.36 () {62 vars in 1364 bytes} [Tue Aug 9 18:20:43 2022] POST /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/os-volume_attachments => generated 188 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:20:44.671043 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6d478b73-2951-4e6d-8f85-958005ec8d82 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:20:44.671720 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-6d478b73-2951-4e6d-8f85-958005ec8d82 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:44.677853 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6d478b73-2951-4e6d-8f85-958005ec8d82 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:44.678336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6d478b73-2951-4e6d-8f85-958005ec8d82 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:44.678810 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6d478b73-2951-4e6d-8f85-958005ec8d82 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:44.679505 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6d478b73-2951-4e6d-8f85-958005ec8d82 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:44.679963 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6d478b73-2951-4e6d-8f85-958005ec8d82 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:44.680387 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6d478b73-2951-4e6d-8f85-958005ec8d82 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:44.768764 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-6d478b73-2951-4e6d-8f85-958005ec8d82 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118313) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 18:20:45.075484 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-6d478b73-2951-4e6d-8f85-958005ec8d82 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "POST /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/action" status: 202 len: 0 microversion: 2.20 time: 0.409187 Aug 09 18:20:45.076102 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 266/524] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Aug 9 18:20:44 2022] POST /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:20:45.084377 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-2166abd3-8a15-4431-ac18-0c7ab35e7eda tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:45.084980 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-2166abd3-8a15-4431-ac18-0c7ab35e7eda tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:45.093894 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2166abd3-8a15-4431-ac18-0c7ab35e7eda tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:45.094458 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2166abd3-8a15-4431-ac18-0c7ab35e7eda tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:45.099662 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2166abd3-8a15-4431-ac18-0c7ab35e7eda tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:45.099662 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2166abd3-8a15-4431-ac18-0c7ab35e7eda tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:45.099662 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2166abd3-8a15-4431-ac18-0c7ab35e7eda tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:45.099662 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2166abd3-8a15-4431-ac18-0c7ab35e7eda tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:45.232838 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-2166abd3-8a15-4431-ac18-0c7ab35e7eda tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:45.242932 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-2166abd3-8a15-4431-ac18-0c7ab35e7eda tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:45.244481 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-2166abd3-8a15-4431-ac18-0c7ab35e7eda tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:45.245653 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-2166abd3-8a15-4431-ac18-0c7ab35e7eda tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1752 microversion: 2.20 time: 0.165271 Aug 09 18:20:45.246224 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 259/525] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:45 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:45.359906 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f8580cd8-3dd3-40b3-9e54-9c4c15747d51 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:45.360523 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f8580cd8-3dd3-40b3-9e54-9c4c15747d51 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: 5884512c-963f-44b6-aa8b-73f754017a43] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:45.366854 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8580cd8-3dd3-40b3-9e54-9c4c15747d51 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:45.374049 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8580cd8-3dd3-40b3-9e54-9c4c15747d51 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:45.374049 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8580cd8-3dd3-40b3-9e54-9c4c15747d51 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:45.374049 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8580cd8-3dd3-40b3-9e54-9c4c15747d51 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:45.374049 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8580cd8-3dd3-40b3-9e54-9c4c15747d51 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:45.374409 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8580cd8-3dd3-40b3-9e54-9c4c15747d51 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:45.502545 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f8580cd8-3dd3-40b3-9e54-9c4c15747d51 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:45.510024 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f8580cd8-3dd3-40b3-9e54-9c4c15747d51 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43" status: 200 len: 1508 microversion: 2.1 time: 0.154018 Aug 09 18:20:45.510596 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 267/526] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:45 2022] GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:45.531459 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-12c9b602-1636-427e-8751-df7dc6221cd8 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8feaf33b-ef5f-4b6a-92e8-2471baeb3490", "device": "/dev/sdb"}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:20:45.534468 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-12c9b602-1636-427e-8751-df7dc6221cd8 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: 5884512c-963f-44b6-aa8b-73f754017a43] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:45.540493 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-12c9b602-1636-427e-8751-df7dc6221cd8 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:45.541092 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-12c9b602-1636-427e-8751-df7dc6221cd8 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:45.541459 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-12c9b602-1636-427e-8751-df7dc6221cd8 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:45.542140 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-12c9b602-1636-427e-8751-df7dc6221cd8 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:45.542592 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-12c9b602-1636-427e-8751-df7dc6221cd8 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:45.543050 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-12c9b602-1636-427e-8751-df7dc6221cd8 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:46.268437 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-12c9b602-1636-427e-8751-df7dc6221cd8 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "POST /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.741221 Aug 09 18:20:46.272509 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 260/527] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Aug 9 18:20:45 2022] POST /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43/os-volume_attachments => generated 194 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:20:46.272734 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-51fb1a7e-85ad-4591-95ad-9fe2ee77c2ea tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:46.272734 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-51fb1a7e-85ad-4591-95ad-9fe2ee77c2ea tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:46.289323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:20:46.295532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-51fb1a7e-85ad-4591-95ad-9fe2ee77c2ea tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:46.296344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-51fb1a7e-85ad-4591-95ad-9fe2ee77c2ea tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:46.297072 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-51fb1a7e-85ad-4591-95ad-9fe2ee77c2ea tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:46.298230 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-51fb1a7e-85ad-4591-95ad-9fe2ee77c2ea tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:46.302310 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-51fb1a7e-85ad-4591-95ad-9fe2ee77c2ea tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:46.303075 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-51fb1a7e-85ad-4591-95ad-9fe2ee77c2ea tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:46.451757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-51fb1a7e-85ad-4591-95ad-9fe2ee77c2ea tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:46.460250 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-51fb1a7e-85ad-4591-95ad-9fe2ee77c2ea tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:46.462653 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-51fb1a7e-85ad-4591-95ad-9fe2ee77c2ea tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:46.464021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-51fb1a7e-85ad-4591-95ad-9fe2ee77c2ea tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1752 microversion: 2.20 time: 0.198547 Aug 09 18:20:46.464954 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 268/528] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:46 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1752 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:20:47.489364 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-60b2fd20-80ab-4c66-9f71-67f2b76f2dae tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:47.490086 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-60b2fd20-80ab-4c66-9f71-67f2b76f2dae tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:47.491990 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=64 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:20:47.496830 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-60b2fd20-80ab-4c66-9f71-67f2b76f2dae tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:47.497313 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-60b2fd20-80ab-4c66-9f71-67f2b76f2dae tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:47.497746 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-60b2fd20-80ab-4c66-9f71-67f2b76f2dae tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:47.498432 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-60b2fd20-80ab-4c66-9f71-67f2b76f2dae tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:47.498923 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-60b2fd20-80ab-4c66-9f71-67f2b76f2dae tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:47.499349 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-60b2fd20-80ab-4c66-9f71-67f2b76f2dae tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:47.633268 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-60b2fd20-80ab-4c66-9f71-67f2b76f2dae tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:47.642052 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-60b2fd20-80ab-4c66-9f71-67f2b76f2dae tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:47.643576 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-60b2fd20-80ab-4c66-9f71-67f2b76f2dae tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:47.644731 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-60b2fd20-80ab-4c66-9f71-67f2b76f2dae tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1754 microversion: 2.20 time: 0.160372 Aug 09 18:20:47.645300 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 261/529] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:47 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:48.667823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-0e3fdaf7-aae4-4f3c-acbc-982be41b0011 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:48.668429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-0e3fdaf7-aae4-4f3c-acbc-982be41b0011 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:48.676065 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0e3fdaf7-aae4-4f3c-acbc-982be41b0011 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:48.676555 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0e3fdaf7-aae4-4f3c-acbc-982be41b0011 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:48.676991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0e3fdaf7-aae4-4f3c-acbc-982be41b0011 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:48.677679 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0e3fdaf7-aae4-4f3c-acbc-982be41b0011 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:48.678188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0e3fdaf7-aae4-4f3c-acbc-982be41b0011 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:48.678612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0e3fdaf7-aae4-4f3c-acbc-982be41b0011 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:48.807125 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-0e3fdaf7-aae4-4f3c-acbc-982be41b0011 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:48.815414 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-0e3fdaf7-aae4-4f3c-acbc-982be41b0011 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:48.816922 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-0e3fdaf7-aae4-4f3c-acbc-982be41b0011 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:48.818064 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-0e3fdaf7-aae4-4f3c-acbc-982be41b0011 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1754 microversion: 2.20 time: 0.154229 Aug 09 18:20:48.818898 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 269/530] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:48 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:49.840006 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f78a9fd0-b09a-4406-ba82-cecc69058b8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:49.840731 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f78a9fd0-b09a-4406-ba82-cecc69058b8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:49.847037 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f78a9fd0-b09a-4406-ba82-cecc69058b8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:49.847513 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f78a9fd0-b09a-4406-ba82-cecc69058b8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:49.847949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f78a9fd0-b09a-4406-ba82-cecc69058b8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:49.848632 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f78a9fd0-b09a-4406-ba82-cecc69058b8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:49.849085 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f78a9fd0-b09a-4406-ba82-cecc69058b8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:49.849502 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f78a9fd0-b09a-4406-ba82-cecc69058b8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:49.979259 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f78a9fd0-b09a-4406-ba82-cecc69058b8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:49.988360 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f78a9fd0-b09a-4406-ba82-cecc69058b8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:49.989849 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f78a9fd0-b09a-4406-ba82-cecc69058b8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:49.991009 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f78a9fd0-b09a-4406-ba82-cecc69058b8b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1754 microversion: 2.20 time: 0.154897 Aug 09 18:20:49.991559 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 262/531] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:49 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:51.014459 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5c94bb00-207c-4688-b261-ef7154999b1d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:51.015108 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-5c94bb00-207c-4688-b261-ef7154999b1d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:51.021434 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5c94bb00-207c-4688-b261-ef7154999b1d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:51.021916 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5c94bb00-207c-4688-b261-ef7154999b1d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:51.022349 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5c94bb00-207c-4688-b261-ef7154999b1d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:51.023067 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5c94bb00-207c-4688-b261-ef7154999b1d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:51.023524 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5c94bb00-207c-4688-b261-ef7154999b1d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:51.023949 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5c94bb00-207c-4688-b261-ef7154999b1d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:51.151935 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-5c94bb00-207c-4688-b261-ef7154999b1d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:51.160308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-5c94bb00-207c-4688-b261-ef7154999b1d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:51.161817 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-5c94bb00-207c-4688-b261-ef7154999b1d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:51.162988 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-5c94bb00-207c-4688-b261-ef7154999b1d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1754 microversion: 2.20 time: 0.153274 Aug 09 18:20:51.163539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 270/532] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:51 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:52.185541 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-08ba8860-5540-4739-adbb-0cf629ddf152 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:52.186132 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-08ba8860-5540-4739-adbb-0cf629ddf152 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:52.192629 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-08ba8860-5540-4739-adbb-0cf629ddf152 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:52.193120 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-08ba8860-5540-4739-adbb-0cf629ddf152 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:52.193558 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-08ba8860-5540-4739-adbb-0cf629ddf152 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:52.194250 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-08ba8860-5540-4739-adbb-0cf629ddf152 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:52.194729 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-08ba8860-5540-4739-adbb-0cf629ddf152 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:52.195157 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-08ba8860-5540-4739-adbb-0cf629ddf152 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:52.326535 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-08ba8860-5540-4739-adbb-0cf629ddf152 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:52.334964 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-08ba8860-5540-4739-adbb-0cf629ddf152 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:52.336480 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-08ba8860-5540-4739-adbb-0cf629ddf152 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:52.337622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-08ba8860-5540-4739-adbb-0cf629ddf152 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1754 microversion: 2.20 time: 0.156122 Aug 09 18:20:52.338421 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 263/533] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:52 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:53.361192 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d43c8317-51dc-48e6-8788-afea50256d4e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:53.361712 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d43c8317-51dc-48e6-8788-afea50256d4e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:53.368156 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d43c8317-51dc-48e6-8788-afea50256d4e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:53.368961 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d43c8317-51dc-48e6-8788-afea50256d4e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:53.369105 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d43c8317-51dc-48e6-8788-afea50256d4e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:53.369744 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d43c8317-51dc-48e6-8788-afea50256d4e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:53.370199 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d43c8317-51dc-48e6-8788-afea50256d4e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:53.370627 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d43c8317-51dc-48e6-8788-afea50256d4e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:53.498912 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d43c8317-51dc-48e6-8788-afea50256d4e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:53.507269 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d43c8317-51dc-48e6-8788-afea50256d4e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:53.508818 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d43c8317-51dc-48e6-8788-afea50256d4e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:53.509966 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d43c8317-51dc-48e6-8788-afea50256d4e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1754 microversion: 2.20 time: 0.153059 Aug 09 18:20:53.510524 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 271/534] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:53 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:54.533213 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-45d00642-9aa8-4861-a737-1dc6d4bd458b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:54.533816 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-45d00642-9aa8-4861-a737-1dc6d4bd458b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:54.540536 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-45d00642-9aa8-4861-a737-1dc6d4bd458b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:54.541013 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-45d00642-9aa8-4861-a737-1dc6d4bd458b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:54.541442 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-45d00642-9aa8-4861-a737-1dc6d4bd458b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:54.542121 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-45d00642-9aa8-4861-a737-1dc6d4bd458b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:54.542602 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-45d00642-9aa8-4861-a737-1dc6d4bd458b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:54.543045 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-45d00642-9aa8-4861-a737-1dc6d4bd458b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:54.676087 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-45d00642-9aa8-4861-a737-1dc6d4bd458b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:54.679565 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:20:54.684866 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-45d00642-9aa8-4861-a737-1dc6d4bd458b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:54.686370 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-45d00642-9aa8-4861-a737-1dc6d4bd458b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:54.687587 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-45d00642-9aa8-4861-a737-1dc6d4bd458b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1754 microversion: 2.20 time: 0.158460 Aug 09 18:20:54.692798 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 264/535] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:54 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:55.711051 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-baeecb69-26dd-41e3-8996-8610e28309dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:55.712207 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-baeecb69-26dd-41e3-8996-8610e28309dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:55.719562 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-baeecb69-26dd-41e3-8996-8610e28309dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:55.720082 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-baeecb69-26dd-41e3-8996-8610e28309dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:55.720524 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-baeecb69-26dd-41e3-8996-8610e28309dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:55.721225 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-baeecb69-26dd-41e3-8996-8610e28309dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:55.721685 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-baeecb69-26dd-41e3-8996-8610e28309dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:55.722146 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-baeecb69-26dd-41e3-8996-8610e28309dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:56.102340 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-baeecb69-26dd-41e3-8996-8610e28309dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:56.111949 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-baeecb69-26dd-41e3-8996-8610e28309dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:56.113490 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-baeecb69-26dd-41e3-8996-8610e28309dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:56.114641 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-baeecb69-26dd-41e3-8996-8610e28309dd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.407710 Aug 09 18:20:56.115222 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 272/536] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:55 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:57.138988 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-35deb787-a7f0-4183-8ec0-056543b916ba tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:57.139577 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-35deb787-a7f0-4183-8ec0-056543b916ba tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:57.146015 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-35deb787-a7f0-4183-8ec0-056543b916ba tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:57.146498 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-35deb787-a7f0-4183-8ec0-056543b916ba tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:57.147025 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-35deb787-a7f0-4183-8ec0-056543b916ba tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:57.147713 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-35deb787-a7f0-4183-8ec0-056543b916ba tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:57.148168 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-35deb787-a7f0-4183-8ec0-056543b916ba tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:57.148590 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-35deb787-a7f0-4183-8ec0-056543b916ba tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:57.276791 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-35deb787-a7f0-4183-8ec0-056543b916ba tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:57.285171 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-35deb787-a7f0-4183-8ec0-056543b916ba tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:57.286685 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-35deb787-a7f0-4183-8ec0-056543b916ba tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:57.287858 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-35deb787-a7f0-4183-8ec0-056543b916ba tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.154361 Aug 09 18:20:57.288651 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 265/537] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:57 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:57.689047 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-7988dc57-e581-4f48-9f88-ea114691af6b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:57.689620 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-7988dc57-e581-4f48-9f88-ea114691af6b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:57.695985 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7988dc57-e581-4f48-9f88-ea114691af6b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:57.696466 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7988dc57-e581-4f48-9f88-ea114691af6b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:57.696903 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7988dc57-e581-4f48-9f88-ea114691af6b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:57.697588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7988dc57-e581-4f48-9f88-ea114691af6b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:57.698044 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7988dc57-e581-4f48-9f88-ea114691af6b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:57.698467 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7988dc57-e581-4f48-9f88-ea114691af6b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:57.721500 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-7988dc57-e581-4f48-9f88-ea114691af6b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e/ips" status: 200 len: 145 microversion: 2.1 time: 0.036323 Aug 09 18:20:57.722063 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 273/538] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Aug 9 18:20:57 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:20:58.311344 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-961da860-932a-4521-8ef7-aeb07c1b4b96 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:58.311966 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-961da860-932a-4521-8ef7-aeb07c1b4b96 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:58.318300 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-961da860-932a-4521-8ef7-aeb07c1b4b96 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:58.318812 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-961da860-932a-4521-8ef7-aeb07c1b4b96 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:58.319246 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-961da860-932a-4521-8ef7-aeb07c1b4b96 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:58.319931 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-961da860-932a-4521-8ef7-aeb07c1b4b96 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:58.321070 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-961da860-932a-4521-8ef7-aeb07c1b4b96 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:58.321070 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-961da860-932a-4521-8ef7-aeb07c1b4b96 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:58.457880 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-961da860-932a-4521-8ef7-aeb07c1b4b96 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:58.467290 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-961da860-932a-4521-8ef7-aeb07c1b4b96 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:58.468818 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-961da860-932a-4521-8ef7-aeb07c1b4b96 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:58.470095 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-961da860-932a-4521-8ef7-aeb07c1b4b96 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.162672 Aug 09 18:20:58.470660 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 266/539] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:58 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:20:59.492927 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-0f3114e5-96f9-4875-9c81-eb44fb889a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:59.493535 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-0f3114e5-96f9-4875-9c81-eb44fb889a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:59.499903 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0f3114e5-96f9-4875-9c81-eb44fb889a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:59.500383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0f3114e5-96f9-4875-9c81-eb44fb889a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:59.500828 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0f3114e5-96f9-4875-9c81-eb44fb889a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:59.501502 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0f3114e5-96f9-4875-9c81-eb44fb889a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:59.501956 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0f3114e5-96f9-4875-9c81-eb44fb889a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:59.502380 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0f3114e5-96f9-4875-9c81-eb44fb889a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:59.713012 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-0f3114e5-96f9-4875-9c81-eb44fb889a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:59.722240 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-0f3114e5-96f9-4875-9c81-eb44fb889a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:59.723802 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-0f3114e5-96f9-4875-9c81-eb44fb889a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:59.724960 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-0f3114e5-96f9-4875-9c81-eb44fb889a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.235940 Aug 09 18:20:59.725519 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 274/540] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:20:59 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:21:00.748564 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-95cf96aa-3ae4-48f4-a441-5ab113502809 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:00.749177 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-95cf96aa-3ae4-48f4-a441-5ab113502809 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:00.755777 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-95cf96aa-3ae4-48f4-a441-5ab113502809 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:00.756274 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-95cf96aa-3ae4-48f4-a441-5ab113502809 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:00.756699 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-95cf96aa-3ae4-48f4-a441-5ab113502809 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:00.757410 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-95cf96aa-3ae4-48f4-a441-5ab113502809 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:00.757921 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-95cf96aa-3ae4-48f4-a441-5ab113502809 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:00.758339 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-95cf96aa-3ae4-48f4-a441-5ab113502809 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:00.900486 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-95cf96aa-3ae4-48f4-a441-5ab113502809 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:00.917771 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-95cf96aa-3ae4-48f4-a441-5ab113502809 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:00.921467 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-95cf96aa-3ae4-48f4-a441-5ab113502809 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:00.923112 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-95cf96aa-3ae4-48f4-a441-5ab113502809 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.179672 Aug 09 18:21:00.923905 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 267/541] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:00 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:21:01.946936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f19652ab-cdb0-498b-b35e-e690437b2289 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:01.947475 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f19652ab-cdb0-498b-b35e-e690437b2289 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:01.953887 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f19652ab-cdb0-498b-b35e-e690437b2289 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:01.954373 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f19652ab-cdb0-498b-b35e-e690437b2289 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:01.954839 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f19652ab-cdb0-498b-b35e-e690437b2289 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:01.955534 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f19652ab-cdb0-498b-b35e-e690437b2289 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:01.955990 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f19652ab-cdb0-498b-b35e-e690437b2289 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:01.956417 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f19652ab-cdb0-498b-b35e-e690437b2289 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:02.095352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f19652ab-cdb0-498b-b35e-e690437b2289 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:02.108894 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f19652ab-cdb0-498b-b35e-e690437b2289 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:02.108894 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f19652ab-cdb0-498b-b35e-e690437b2289 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:02.108894 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f19652ab-cdb0-498b-b35e-e690437b2289 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.164495 Aug 09 18:21:02.109239 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 275/542] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:01 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:21:02.137544 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-32656fa8-0013-4bc5-b716-6fb3f1385af4 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "949fb134-fb39-4f32-bb9e-2cd4ccb90c2f"}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:21:02.140267 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-32656fa8-0013-4bc5-b716-6fb3f1385af4 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:02.148238 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-32656fa8-0013-4bc5-b716-6fb3f1385af4 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:02.149022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-32656fa8-0013-4bc5-b716-6fb3f1385af4 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:02.149457 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-32656fa8-0013-4bc5-b716-6fb3f1385af4 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:02.150287 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-32656fa8-0013-4bc5-b716-6fb3f1385af4 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:02.150856 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-32656fa8-0013-4bc5-b716-6fb3f1385af4 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:02.151286 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-32656fa8-0013-4bc5-b716-6fb3f1385af4 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:03.132013 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d951795d-9d85-47c3-8b3f-e70ef759a25a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:03.133577 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d951795d-9d85-47c3-8b3f-e70ef759a25a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:03.141181 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d951795d-9d85-47c3-8b3f-e70ef759a25a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:03.141677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d951795d-9d85-47c3-8b3f-e70ef759a25a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:03.142113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d951795d-9d85-47c3-8b3f-e70ef759a25a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:03.142884 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d951795d-9d85-47c3-8b3f-e70ef759a25a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:03.143369 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d951795d-9d85-47c3-8b3f-e70ef759a25a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:03.143825 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d951795d-9d85-47c3-8b3f-e70ef759a25a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:03.284155 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d951795d-9d85-47c3-8b3f-e70ef759a25a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:03.292591 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d951795d-9d85-47c3-8b3f-e70ef759a25a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:03.294113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d951795d-9d85-47c3-8b3f-e70ef759a25a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:03.295310 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d951795d-9d85-47c3-8b3f-e70ef759a25a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.167176 Aug 09 18:21:03.295878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 276/543] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:03 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:21:04.319159 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e5fa39f3-26d0-4323-88a7-3b8bfe5feeaf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:04.319937 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e5fa39f3-26d0-4323-88a7-3b8bfe5feeaf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:04.326609 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e5fa39f3-26d0-4323-88a7-3b8bfe5feeaf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:04.327121 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e5fa39f3-26d0-4323-88a7-3b8bfe5feeaf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:04.328997 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e5fa39f3-26d0-4323-88a7-3b8bfe5feeaf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:04.329705 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e5fa39f3-26d0-4323-88a7-3b8bfe5feeaf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:04.330164 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e5fa39f3-26d0-4323-88a7-3b8bfe5feeaf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:04.330596 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e5fa39f3-26d0-4323-88a7-3b8bfe5feeaf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:04.473462 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e5fa39f3-26d0-4323-88a7-3b8bfe5feeaf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:04.481737 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e5fa39f3-26d0-4323-88a7-3b8bfe5feeaf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:04.483302 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e5fa39f3-26d0-4323-88a7-3b8bfe5feeaf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:04.484448 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e5fa39f3-26d0-4323-88a7-3b8bfe5feeaf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.169424 Aug 09 18:21:04.485005 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 277/544] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:04 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:21:05.510547 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-135b5597-487e-4cc6-a628-d7ee19b1c78f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:05.512201 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-135b5597-487e-4cc6-a628-d7ee19b1c78f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:05.519682 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-135b5597-487e-4cc6-a628-d7ee19b1c78f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:05.520392 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-135b5597-487e-4cc6-a628-d7ee19b1c78f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:05.520904 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-135b5597-487e-4cc6-a628-d7ee19b1c78f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:05.521735 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-135b5597-487e-4cc6-a628-d7ee19b1c78f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:05.522241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-135b5597-487e-4cc6-a628-d7ee19b1c78f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:05.522806 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-135b5597-487e-4cc6-a628-d7ee19b1c78f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:05.540015 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:21:05.664806 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-135b5597-487e-4cc6-a628-d7ee19b1c78f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:05.674228 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-135b5597-487e-4cc6-a628-d7ee19b1c78f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:05.675872 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-135b5597-487e-4cc6-a628-d7ee19b1c78f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:05.677134 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-135b5597-487e-4cc6-a628-d7ee19b1c78f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.171599 Aug 09 18:21:05.687257 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 278/545] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:05 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:21:06.701249 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-fd770898-6d58-43d8-996e-8f9747f32dfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:06.701945 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-fd770898-6d58-43d8-996e-8f9747f32dfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:06.708698 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fd770898-6d58-43d8-996e-8f9747f32dfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:06.709177 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fd770898-6d58-43d8-996e-8f9747f32dfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:06.709613 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fd770898-6d58-43d8-996e-8f9747f32dfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:06.710295 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fd770898-6d58-43d8-996e-8f9747f32dfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:06.710926 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fd770898-6d58-43d8-996e-8f9747f32dfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:06.711357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fd770898-6d58-43d8-996e-8f9747f32dfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:06.838175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-fd770898-6d58-43d8-996e-8f9747f32dfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:06.847142 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-fd770898-6d58-43d8-996e-8f9747f32dfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:06.848652 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-fd770898-6d58-43d8-996e-8f9747f32dfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:06.849810 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-fd770898-6d58-43d8-996e-8f9747f32dfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.152438 Aug 09 18:21:06.850368 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 279/546] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:06 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:21:07.875955 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-17c82101-02fe-4b2f-9059-336157f0d0bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:07.877537 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-17c82101-02fe-4b2f-9059-336157f0d0bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:07.884967 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-17c82101-02fe-4b2f-9059-336157f0d0bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:07.885807 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-17c82101-02fe-4b2f-9059-336157f0d0bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:07.886485 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-17c82101-02fe-4b2f-9059-336157f0d0bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:07.887457 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-17c82101-02fe-4b2f-9059-336157f0d0bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:07.888136 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-17c82101-02fe-4b2f-9059-336157f0d0bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:07.888918 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-17c82101-02fe-4b2f-9059-336157f0d0bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:08.039092 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-17c82101-02fe-4b2f-9059-336157f0d0bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:08.048396 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-17c82101-02fe-4b2f-9059-336157f0d0bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:08.049962 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-17c82101-02fe-4b2f-9059-336157f0d0bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:08.051199 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-17c82101-02fe-4b2f-9059-336157f0d0bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.179624 Aug 09 18:21:08.051753 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 280/547] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:07 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:21:09.074156 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-cc099b83-83a6-485d-9dfa-a5ab67463a2f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:09.074890 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-cc099b83-83a6-485d-9dfa-a5ab67463a2f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:09.081603 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc099b83-83a6-485d-9dfa-a5ab67463a2f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:09.082080 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc099b83-83a6-485d-9dfa-a5ab67463a2f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:09.082513 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc099b83-83a6-485d-9dfa-a5ab67463a2f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:09.083226 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc099b83-83a6-485d-9dfa-a5ab67463a2f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:09.083686 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc099b83-83a6-485d-9dfa-a5ab67463a2f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:09.084107 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc099b83-83a6-485d-9dfa-a5ab67463a2f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:09.213708 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-cc099b83-83a6-485d-9dfa-a5ab67463a2f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:09.222689 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-cc099b83-83a6-485d-9dfa-a5ab67463a2f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:09.224254 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-cc099b83-83a6-485d-9dfa-a5ab67463a2f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:09.225408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-cc099b83-83a6-485d-9dfa-a5ab67463a2f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.155185 Aug 09 18:21:09.225965 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 281/548] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:09 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:21:10.248560 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6bd7a27e-3612-4871-b6a6-703ee2d23af1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:10.249205 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-6bd7a27e-3612-4871-b6a6-703ee2d23af1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:10.256136 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6bd7a27e-3612-4871-b6a6-703ee2d23af1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:10.256611 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6bd7a27e-3612-4871-b6a6-703ee2d23af1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:10.257042 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6bd7a27e-3612-4871-b6a6-703ee2d23af1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:10.257818 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6bd7a27e-3612-4871-b6a6-703ee2d23af1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:10.258295 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6bd7a27e-3612-4871-b6a6-703ee2d23af1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:10.258737 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6bd7a27e-3612-4871-b6a6-703ee2d23af1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:10.396076 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6bd7a27e-3612-4871-b6a6-703ee2d23af1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:10.404846 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6bd7a27e-3612-4871-b6a6-703ee2d23af1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:10.406472 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6bd7a27e-3612-4871-b6a6-703ee2d23af1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:10.407827 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-6bd7a27e-3612-4871-b6a6-703ee2d23af1 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.163153 Aug 09 18:21:10.408387 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 282/549] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:10 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:21:11.431337 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-961b3684-f259-455a-bc11-a892abb35890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:11.431987 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-961b3684-f259-455a-bc11-a892abb35890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:11.440649 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-961b3684-f259-455a-bc11-a892abb35890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:11.441320 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-961b3684-f259-455a-bc11-a892abb35890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:11.441802 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-961b3684-f259-455a-bc11-a892abb35890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:11.442889 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-961b3684-f259-455a-bc11-a892abb35890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:11.443436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-961b3684-f259-455a-bc11-a892abb35890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:11.443953 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-961b3684-f259-455a-bc11-a892abb35890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:11.586426 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-961b3684-f259-455a-bc11-a892abb35890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:11.595843 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-961b3684-f259-455a-bc11-a892abb35890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:11.597346 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-961b3684-f259-455a-bc11-a892abb35890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:11.598509 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-961b3684-f259-455a-bc11-a892abb35890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.171512 Aug 09 18:21:11.599104 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 283/550] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:11 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:21:12.148218 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=15 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:21:12.225785 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=24 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:21:12.621990 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-cc57a0d0-11cd-4cc4-93bb-9290d31ec0c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:12.622599 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-cc57a0d0-11cd-4cc4-93bb-9290d31ec0c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:12.629599 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc57a0d0-11cd-4cc4-93bb-9290d31ec0c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:12.630074 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc57a0d0-11cd-4cc4-93bb-9290d31ec0c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:12.630506 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc57a0d0-11cd-4cc4-93bb-9290d31ec0c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:12.631245 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc57a0d0-11cd-4cc4-93bb-9290d31ec0c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:12.631698 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc57a0d0-11cd-4cc4-93bb-9290d31ec0c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:12.632116 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc57a0d0-11cd-4cc4-93bb-9290d31ec0c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:12.771461 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-cc57a0d0-11cd-4cc4-93bb-9290d31ec0c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:12.779783 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-cc57a0d0-11cd-4cc4-93bb-9290d31ec0c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:12.781302 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-cc57a0d0-11cd-4cc4-93bb-9290d31ec0c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:12.782597 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-cc57a0d0-11cd-4cc4-93bb-9290d31ec0c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.164463 Aug 09 18:21:12.783312 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 284/551] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:12 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:21:13.806128 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-abcf7ff7-76c5-4c8d-9a56-895d7f892b45 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:13.806881 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-abcf7ff7-76c5-4c8d-9a56-895d7f892b45 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:13.813249 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-abcf7ff7-76c5-4c8d-9a56-895d7f892b45 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:13.813736 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-abcf7ff7-76c5-4c8d-9a56-895d7f892b45 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:13.814174 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-abcf7ff7-76c5-4c8d-9a56-895d7f892b45 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:13.814912 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-abcf7ff7-76c5-4c8d-9a56-895d7f892b45 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:13.815372 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-abcf7ff7-76c5-4c8d-9a56-895d7f892b45 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:13.815798 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-abcf7ff7-76c5-4c8d-9a56-895d7f892b45 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:13.953052 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-abcf7ff7-76c5-4c8d-9a56-895d7f892b45 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:13.962553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-abcf7ff7-76c5-4c8d-9a56-895d7f892b45 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:13.964092 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-abcf7ff7-76c5-4c8d-9a56-895d7f892b45 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:13.965243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-abcf7ff7-76c5-4c8d-9a56-895d7f892b45 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.163163 Aug 09 18:21:13.965804 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 285/552] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:13 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:21:14.763001 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-0a7f5c3b-4360-4e78-9268-6fb5b8baa9a0 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:14.763495 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-0a7f5c3b-4360-4e78-9268-6fb5b8baa9a0 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: 5884512c-963f-44b6-aa8b-73f754017a43] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:14.770176 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0a7f5c3b-4360-4e78-9268-6fb5b8baa9a0 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:14.770831 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0a7f5c3b-4360-4e78-9268-6fb5b8baa9a0 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:14.771281 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0a7f5c3b-4360-4e78-9268-6fb5b8baa9a0 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:14.771970 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0a7f5c3b-4360-4e78-9268-6fb5b8baa9a0 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:14.772422 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0a7f5c3b-4360-4e78-9268-6fb5b8baa9a0 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:14.772841 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0a7f5c3b-4360-4e78-9268-6fb5b8baa9a0 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:14.902238 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.objects.instance [None req-0a7f5c3b-4360-4e78-9268-6fb5b8baa9a0 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lazy-loading 'services' on Instance uuid 5884512c-963f-44b6-aa8b-73f754017a43 {{(pid=118313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:21:15.185083 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-0a7f5c3b-4360-4e78-9268-6fb5b8baa9a0 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43/os-volume_attachments/8feaf33b-ef5f-4b6a-92e8-2471baeb3490" status: 202 len: 0 microversion: 2.1 time: 0.425670 Aug 09 18:21:15.185750 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 286/553] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Aug 9 18:21:14 2022] DELETE /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43/os-volume_attachments/8feaf33b-ef5f-4b6a-92e8-2471baeb3490 => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:21:15.191201 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-8ed70c17-62f6-42df-a331-067338de464c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:15.199969 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-8ed70c17-62f6-42df-a331-067338de464c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:15.206735 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8ed70c17-62f6-42df-a331-067338de464c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:15.207819 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8ed70c17-62f6-42df-a331-067338de464c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:15.208744 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8ed70c17-62f6-42df-a331-067338de464c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:15.209477 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8ed70c17-62f6-42df-a331-067338de464c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:15.209939 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8ed70c17-62f6-42df-a331-067338de464c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:15.210363 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8ed70c17-62f6-42df-a331-067338de464c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:15.355454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-8ed70c17-62f6-42df-a331-067338de464c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:15.370724 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-8ed70c17-62f6-42df-a331-067338de464c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:15.372283 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-8ed70c17-62f6-42df-a331-067338de464c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:15.373445 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-8ed70c17-62f6-42df-a331-067338de464c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.186491 Aug 09 18:21:15.374007 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 287/554] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:15 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:21:16.398495 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9977daa4-d233-4b93-ab33-bf6e57ac0f75 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:16.399431 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9977daa4-d233-4b93-ab33-bf6e57ac0f75 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:16.405971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9977daa4-d233-4b93-ab33-bf6e57ac0f75 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:16.406456 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9977daa4-d233-4b93-ab33-bf6e57ac0f75 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:16.406927 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9977daa4-d233-4b93-ab33-bf6e57ac0f75 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:16.407619 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9977daa4-d233-4b93-ab33-bf6e57ac0f75 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:16.408069 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9977daa4-d233-4b93-ab33-bf6e57ac0f75 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:16.408486 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9977daa4-d233-4b93-ab33-bf6e57ac0f75 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:16.547346 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9977daa4-d233-4b93-ab33-bf6e57ac0f75 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:16.557171 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9977daa4-d233-4b93-ab33-bf6e57ac0f75 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:16.558693 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9977daa4-d233-4b93-ab33-bf6e57ac0f75 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:16.559890 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9977daa4-d233-4b93-ab33-bf6e57ac0f75 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.166313 Aug 09 18:21:16.560542 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 288/555] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:16 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:21:17.584109 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-37471348-2c80-43e7-9efd-b15082a0092c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:17.584775 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-37471348-2c80-43e7-9efd-b15082a0092c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:17.591026 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-37471348-2c80-43e7-9efd-b15082a0092c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:17.591512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-37471348-2c80-43e7-9efd-b15082a0092c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:17.591952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-37471348-2c80-43e7-9efd-b15082a0092c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:17.592632 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-37471348-2c80-43e7-9efd-b15082a0092c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:17.593085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-37471348-2c80-43e7-9efd-b15082a0092c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:17.593507 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-37471348-2c80-43e7-9efd-b15082a0092c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:17.723522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-37471348-2c80-43e7-9efd-b15082a0092c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:17.733052 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-37471348-2c80-43e7-9efd-b15082a0092c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:17.734601 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-37471348-2c80-43e7-9efd-b15082a0092c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:17.736069 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-37471348-2c80-43e7-9efd-b15082a0092c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.155955 Aug 09 18:21:17.742641 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 289/556] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:17 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:21:18.761038 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e3284b5e-424f-46d2-bcfb-baf60ad1d5cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:18.761698 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e3284b5e-424f-46d2-bcfb-baf60ad1d5cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:18.764076 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=43 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:21:18.768725 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e3284b5e-424f-46d2-bcfb-baf60ad1d5cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:18.769212 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e3284b5e-424f-46d2-bcfb-baf60ad1d5cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:18.770456 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e3284b5e-424f-46d2-bcfb-baf60ad1d5cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:18.771192 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e3284b5e-424f-46d2-bcfb-baf60ad1d5cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:18.771653 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e3284b5e-424f-46d2-bcfb-baf60ad1d5cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:18.776915 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e3284b5e-424f-46d2-bcfb-baf60ad1d5cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:18.904186 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e3284b5e-424f-46d2-bcfb-baf60ad1d5cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:18.912871 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e3284b5e-424f-46d2-bcfb-baf60ad1d5cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:18.914380 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e3284b5e-424f-46d2-bcfb-baf60ad1d5cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:18.915552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e3284b5e-424f-46d2-bcfb-baf60ad1d5cf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.158482 Aug 09 18:21:18.916121 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 290/557] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:18 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:21:19.814597 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-32656fa8-0013-4bc5-b716-6fb3f1385af4 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "POST /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 17.681521 Aug 09 18:21:19.815246 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 268/558] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Aug 9 18:21:02 2022] POST /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e/os-volume_attachments => generated 194 bytes in 17683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:21:19.939084 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6a34c95e-ed3a-438b-8863-09f4474d6a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:19.939595 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-6a34c95e-ed3a-438b-8863-09f4474d6a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:19.946005 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6a34c95e-ed3a-438b-8863-09f4474d6a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:19.946485 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6a34c95e-ed3a-438b-8863-09f4474d6a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:19.947057 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6a34c95e-ed3a-438b-8863-09f4474d6a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:19.947618 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6a34c95e-ed3a-438b-8863-09f4474d6a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:19.948080 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6a34c95e-ed3a-438b-8863-09f4474d6a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:19.948504 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6a34c95e-ed3a-438b-8863-09f4474d6a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:20.075349 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6a34c95e-ed3a-438b-8863-09f4474d6a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:20.083865 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6a34c95e-ed3a-438b-8863-09f4474d6a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:20.085399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6a34c95e-ed3a-438b-8863-09f4474d6a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:20.086556 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-6a34c95e-ed3a-438b-8863-09f4474d6a19 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.151441 Aug 09 18:21:20.087166 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 291/559] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:19 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:21:21.111046 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e509d5a2-a8d4-4a84-ba23-a59dc92436d0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:21.111771 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e509d5a2-a8d4-4a84-ba23-a59dc92436d0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:21.119741 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e509d5a2-a8d4-4a84-ba23-a59dc92436d0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:21.120228 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e509d5a2-a8d4-4a84-ba23-a59dc92436d0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:21.120656 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e509d5a2-a8d4-4a84-ba23-a59dc92436d0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:21.121334 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e509d5a2-a8d4-4a84-ba23-a59dc92436d0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:21.121787 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e509d5a2-a8d4-4a84-ba23-a59dc92436d0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:21.122205 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e509d5a2-a8d4-4a84-ba23-a59dc92436d0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:21.250188 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e509d5a2-a8d4-4a84-ba23-a59dc92436d0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:21.259499 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e509d5a2-a8d4-4a84-ba23-a59dc92436d0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:21.261001 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e509d5a2-a8d4-4a84-ba23-a59dc92436d0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:21.262148 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e509d5a2-a8d4-4a84-ba23-a59dc92436d0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.156052 Aug 09 18:21:21.262726 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 269/560] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:21 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:21:22.284901 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-56709c16-3621-4529-8347-81abcc3d6861 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:22.285488 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-56709c16-3621-4529-8347-81abcc3d6861 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:22.292206 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-56709c16-3621-4529-8347-81abcc3d6861 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:22.292688 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-56709c16-3621-4529-8347-81abcc3d6861 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:22.293126 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-56709c16-3621-4529-8347-81abcc3d6861 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:22.293810 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-56709c16-3621-4529-8347-81abcc3d6861 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:22.294271 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-56709c16-3621-4529-8347-81abcc3d6861 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:22.294793 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-56709c16-3621-4529-8347-81abcc3d6861 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:22.428227 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-56709c16-3621-4529-8347-81abcc3d6861 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:22.436526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-56709c16-3621-4529-8347-81abcc3d6861 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:22.438059 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-56709c16-3621-4529-8347-81abcc3d6861 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:22.439227 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-56709c16-3621-4529-8347-81abcc3d6861 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.158302 Aug 09 18:21:22.439780 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 292/561] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:22 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:21:22.667303 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-be18ee58-172a-4db7-934f-119befedeb60 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:22.667805 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-be18ee58-172a-4db7-934f-119befedeb60 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: 5884512c-963f-44b6-aa8b-73f754017a43] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:22.674134 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-be18ee58-172a-4db7-934f-119befedeb60 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:22.674614 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-be18ee58-172a-4db7-934f-119befedeb60 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:22.675096 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-be18ee58-172a-4db7-934f-119befedeb60 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:22.675774 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-be18ee58-172a-4db7-934f-119befedeb60 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:22.676222 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-be18ee58-172a-4db7-934f-119befedeb60 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:22.676645 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-be18ee58-172a-4db7-934f-119befedeb60 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:22.700790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-be18ee58-172a-4db7-934f-119befedeb60 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: 5884512c-963f-44b6-aa8b-73f754017a43] Going to try to terminate instance {{(pid=118314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:21:22.999634 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-be18ee58-172a-4db7-934f-119befedeb60 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43" status: 204 len: 0 microversion: 2.1 time: 0.335881 Aug 09 18:21:23.000232 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 270/562] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:21:22 2022] DELETE /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:21:23.008780 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-df0ae9ee-6245-43bd-9eab-925967f9ba83 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:23.009376 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-df0ae9ee-6245-43bd-9eab-925967f9ba83 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: 5884512c-963f-44b6-aa8b-73f754017a43] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:23.015279 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-df0ae9ee-6245-43bd-9eab-925967f9ba83 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:23.019341 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-df0ae9ee-6245-43bd-9eab-925967f9ba83 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:23.019341 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-df0ae9ee-6245-43bd-9eab-925967f9ba83 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:23.019341 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-df0ae9ee-6245-43bd-9eab-925967f9ba83 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:23.019341 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-df0ae9ee-6245-43bd-9eab-925967f9ba83 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:23.019795 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-df0ae9ee-6245-43bd-9eab-925967f9ba83 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:23.149961 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-df0ae9ee-6245-43bd-9eab-925967f9ba83 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:23.157405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-df0ae9ee-6245-43bd-9eab-925967f9ba83 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43" status: 200 len: 1514 microversion: 2.1 time: 0.152998 Aug 09 18:21:23.157964 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 293/563] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:23 2022] GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:21:23.462385 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-0f5956dc-52e8-4968-926b-85c39426d97c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:23.463110 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-0f5956dc-52e8-4968-926b-85c39426d97c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:23.469022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0f5956dc-52e8-4968-926b-85c39426d97c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:23.469512 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0f5956dc-52e8-4968-926b-85c39426d97c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:23.469951 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0f5956dc-52e8-4968-926b-85c39426d97c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:23.470644 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0f5956dc-52e8-4968-926b-85c39426d97c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:23.471124 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0f5956dc-52e8-4968-926b-85c39426d97c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:23.471550 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0f5956dc-52e8-4968-926b-85c39426d97c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:23.603619 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-0f5956dc-52e8-4968-926b-85c39426d97c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:23.612176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-0f5956dc-52e8-4968-926b-85c39426d97c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:23.613683 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-0f5956dc-52e8-4968-926b-85c39426d97c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:23.615500 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-0f5956dc-52e8-4968-926b-85c39426d97c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.156726 Aug 09 18:21:23.616058 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 271/564] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:23 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:21:24.178801 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6e5eaa1f-9452-4ac3-b7d8-fc59e9462f53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:24.179490 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-6e5eaa1f-9452-4ac3-b7d8-fc59e9462f53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: 5884512c-963f-44b6-aa8b-73f754017a43] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:24.185715 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e5eaa1f-9452-4ac3-b7d8-fc59e9462f53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:24.186189 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e5eaa1f-9452-4ac3-b7d8-fc59e9462f53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:24.186621 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e5eaa1f-9452-4ac3-b7d8-fc59e9462f53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:24.187521 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e5eaa1f-9452-4ac3-b7d8-fc59e9462f53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:24.187968 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e5eaa1f-9452-4ac3-b7d8-fc59e9462f53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:24.188389 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e5eaa1f-9452-4ac3-b7d8-fc59e9462f53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:24.203053 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:21:24.316090 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6e5eaa1f-9452-4ac3-b7d8-fc59e9462f53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:24.323643 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-6e5eaa1f-9452-4ac3-b7d8-fc59e9462f53 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43" status: 200 len: 1514 microversion: 2.1 time: 0.148707 Aug 09 18:21:24.324204 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 294/565] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:24 2022] GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:21:24.637635 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-2758efd7-31a3-4fcf-b955-d1b98886c784 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:24.638169 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-2758efd7-31a3-4fcf-b955-d1b98886c784 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:24.644507 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2758efd7-31a3-4fcf-b955-d1b98886c784 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:24.644983 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2758efd7-31a3-4fcf-b955-d1b98886c784 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:24.645414 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2758efd7-31a3-4fcf-b955-d1b98886c784 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:24.646438 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2758efd7-31a3-4fcf-b955-d1b98886c784 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:24.646738 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2758efd7-31a3-4fcf-b955-d1b98886c784 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:24.647177 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2758efd7-31a3-4fcf-b955-d1b98886c784 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:24.781553 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-2758efd7-31a3-4fcf-b955-d1b98886c784 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:24.790919 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-2758efd7-31a3-4fcf-b955-d1b98886c784 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:24.792427 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-2758efd7-31a3-4fcf-b955-d1b98886c784 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:24.793575 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-2758efd7-31a3-4fcf-b955-d1b98886c784 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.159999 Aug 09 18:21:24.794136 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 272/566] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:24 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:21:25.345549 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9b3940bb-85d2-4b88-9cc3-6d07d2b6cf62 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:25.346111 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9b3940bb-85d2-4b88-9cc3-6d07d2b6cf62 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: 5884512c-963f-44b6-aa8b-73f754017a43] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:25.353205 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9b3940bb-85d2-4b88-9cc3-6d07d2b6cf62 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:25.353683 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9b3940bb-85d2-4b88-9cc3-6d07d2b6cf62 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:25.354115 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9b3940bb-85d2-4b88-9cc3-6d07d2b6cf62 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:25.354818 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9b3940bb-85d2-4b88-9cc3-6d07d2b6cf62 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:25.355266 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9b3940bb-85d2-4b88-9cc3-6d07d2b6cf62 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:25.355682 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9b3940bb-85d2-4b88-9cc3-6d07d2b6cf62 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:25.446628 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9b3940bb-85d2-4b88-9cc3-6d07d2b6cf62 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee3fa12c3f448a9a419200051a02ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1835c316b47c4cb08db14e0eb6e23c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:25.456325 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9b3940bb-85d2-4b88-9cc3-6d07d2b6cf62 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43" status: 200 len: 1472 microversion: 2.1 time: 0.113308 Aug 09 18:21:25.463109 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 295/567] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:25 2022] GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43 => generated 1472 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:21:25.540032 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-3dd01ae7-cfc7-4a3a-832d-f0f51241dfe9 req-e03c421c-e0e6-4dfb-924b-019479c0872b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5884512c-963f-44b6-aa8b-73f754017a43", "name": "network-vif-deleted", "tag": "ebbe6f7e-a432-4386-8b97-4b471fce247f"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:21:25.549469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-3dd01ae7-cfc7-4a3a-832d-f0f51241dfe9 req-e03c421c-e0e6-4dfb-924b-019479c0872b service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:25.550001 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-3dd01ae7-cfc7-4a3a-832d-f0f51241dfe9 req-e03c421c-e0e6-4dfb-924b-019479c0872b service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:25.550433 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-3dd01ae7-cfc7-4a3a-832d-f0f51241dfe9 req-e03c421c-e0e6-4dfb-924b-019479c0872b service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:25.563537 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-3dd01ae7-cfc7-4a3a-832d-f0f51241dfe9 req-e03c421c-e0e6-4dfb-924b-019479c0872b service nova] Creating event network-vif-deleted:ebbe6f7e-a432-4386-8b97-4b471fce247f for instance 5884512c-963f-44b6-aa8b-73f754017a43 on hv-cinder-79797 Aug 09 18:21:25.568688 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-3dd01ae7-cfc7-4a3a-832d-f0f51241dfe9 req-e03c421c-e0e6-4dfb-924b-019479c0872b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091334 Aug 09 18:21:25.569211 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 273/568] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:21:25.816312 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-1bc3bf5a-4201-4238-b023-be33fb593bcb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:25.817231 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-1bc3bf5a-4201-4238-b023-be33fb593bcb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:25.824112 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1bc3bf5a-4201-4238-b023-be33fb593bcb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:25.824595 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1bc3bf5a-4201-4238-b023-be33fb593bcb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:25.825034 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1bc3bf5a-4201-4238-b023-be33fb593bcb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:25.825715 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1bc3bf5a-4201-4238-b023-be33fb593bcb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:25.826163 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1bc3bf5a-4201-4238-b023-be33fb593bcb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:25.826582 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1bc3bf5a-4201-4238-b023-be33fb593bcb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:25.966027 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-1bc3bf5a-4201-4238-b023-be33fb593bcb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:25.974431 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-1bc3bf5a-4201-4238-b023-be33fb593bcb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:25.976010 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-1bc3bf5a-4201-4238-b023-be33fb593bcb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:25.977164 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-1bc3bf5a-4201-4238-b023-be33fb593bcb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.164754 Aug 09 18:21:25.977738 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 296/569] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:25 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:21:26.477680 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-11d479a8-cbf5-4017-a67c-1e82436ca956 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:26.478370 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-11d479a8-cbf5-4017-a67c-1e82436ca956 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] [instance: 5884512c-963f-44b6-aa8b-73f754017a43] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:26.484545 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-11d479a8-cbf5-4017-a67c-1e82436ca956 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:26.485020 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-11d479a8-cbf5-4017-a67c-1e82436ca956 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:26.485452 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-11d479a8-cbf5-4017-a67c-1e82436ca956 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:26.486382 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-11d479a8-cbf5-4017-a67c-1e82436ca956 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:26.486869 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-11d479a8-cbf5-4017-a67c-1e82436ca956 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:26.487294 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-11d479a8-cbf5-4017-a67c-1e82436ca956 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:26.500542 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-11d479a8-cbf5-4017-a67c-1e82436ca956 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] HTTP exception thrown: Instance 5884512c-963f-44b6-aa8b-73f754017a43 could not be found. Aug 09 18:21:26.502596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-11d479a8-cbf5-4017-a67c-1e82436ca956 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Request method failure captured: Aug 09 18:21:26.502596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43 HTTP/1.1 Aug 09 18:21:26.502596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:21:26.502596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:21:26.502596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:21:26.502596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 0 Aug 09 18:21:26.502596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:21:26.502596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:21:26.502596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:21:26.502596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:21:26.502596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qTyhojQ4IRkT5cli773i0IR79YGnup16sqJn46SCZs3L1dT2IMl4aEnlRThvHHRBo5XXtykwlvBj_IYwVApLq_826aS01FsOglbG1M1ZkcDkHRjXggTTMjXEVneOAcjnOrJcz9nnLqMDGrMDUbXbWzT8hldf9KL-7DbdYBMYwYJGLI Aug 09 18:21:26.502596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:21:26.502596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:21:26.502596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:21:26.502596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:21:26.502596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:21:26.502596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:21:26.502596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: 1835c316b47c4cb08db14e0eb6e23c97 Aug 09 18:21:26.502596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1499154502 Aug 09 18:21:26.502596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:21:26.502596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:21:26.504182 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1835c316b47c4cb08db14e0eb6e23c97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1835c316b47c4cb08db14e0eb6e23c97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1835c316b47c4cb08db14e0eb6e23c97", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1835c316b47c4cb08db14e0eb6e23c97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:21:26.504182 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-VolumesSnapshotTestJSON-1499154502 Aug 09 18:21:26.504182 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: 1835c316b47c4cb08db14e0eb6e23c97 Aug 09 18:21:26.504182 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1499154502 Aug 09 18:21:26.504182 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-VolumesSnapshotTestJSON-1499154502-project Aug 09 18:21:26.504182 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:21:26.504182 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:21:26.504182 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: 6ee3fa12c3f448a9a419200051a02ab6 Aug 09 18:21:26.504182 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-VolumesSnapshotTestJSON-1499154502-project Aug 09 18:21:26.504182 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: > Aug 09 18:21:26.504182 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Instance 5884512c-963f-44b6-aa8b-73f754017a43 could not be found. Aug 09 18:21:26.504182 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'id': '5884512c-963f-44b6-aa8b-73f754017a43'} Aug 09 18:21:26.505129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:21:26.505129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:21:26.505129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:21:26.505129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:21:26.505129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:21:26.505129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:21:26.505129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:21:26.505129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:21:26.505129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:21:26.505129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:21:26.505129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5884512c-963f-44b6-aa8b-73f754017a43 could not be found. Aug 09 18:21:26.505129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:21:26.505129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:21:26.505129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:21:26.505129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:21:26.505129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:21:26.505129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:21:26.505129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:21:26.505129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:21:26.505129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:21:26.508038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:21:26.508038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:21:26.508038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:21:26.508038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:21:26.508038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:21:26.508038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:21:26.508038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:21:26.508038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5884512c-963f-44b6-aa8b-73f754017a43 could not be found. Aug 09 18:21:26.508038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:21:26.508038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:21:26.508038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:21:26.508038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:21:26.508038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:21:26.508038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:21:26.508038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:21:26.508038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:21:26.508038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5884512c-963f-44b6-aa8b-73f754017a43 could not be found. Aug 09 18:21:26.508038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:21:26.509485 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-11d479a8-cbf5-4017-a67c-1e82436ca956 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] Returning 404 to user: Instance 5884512c-963f-44b6-aa8b-73f754017a43 could not be found. {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:21:26.509485 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-11d479a8-cbf5-4017-a67c-1e82436ca956 tempest-VolumesSnapshotTestJSON-1499154502 tempest-VolumesSnapshotTestJSON-1499154502-project] 10.222.0.36 "GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43" status: 404 len: 111 microversion: 2.1 time: 0.030693 Aug 09 18:21:26.509485 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 274/570] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:26 2022] GET /compute/v2.1/servers/5884512c-963f-44b6-aa8b-73f754017a43 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:21:27.000005 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-57bd3f05-25ef-47fd-b509-ebfd26c84c82 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:27.000673 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-57bd3f05-25ef-47fd-b509-ebfd26c84c82 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:27.007570 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-57bd3f05-25ef-47fd-b509-ebfd26c84c82 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:27.008204 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-57bd3f05-25ef-47fd-b509-ebfd26c84c82 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:27.008478 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-57bd3f05-25ef-47fd-b509-ebfd26c84c82 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:27.010725 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-57bd3f05-25ef-47fd-b509-ebfd26c84c82 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:27.010725 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-57bd3f05-25ef-47fd-b509-ebfd26c84c82 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:27.010725 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-57bd3f05-25ef-47fd-b509-ebfd26c84c82 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:27.146637 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-57bd3f05-25ef-47fd-b509-ebfd26c84c82 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:27.155100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-57bd3f05-25ef-47fd-b509-ebfd26c84c82 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:27.158292 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-57bd3f05-25ef-47fd-b509-ebfd26c84c82 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:27.158292 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-57bd3f05-25ef-47fd-b509-ebfd26c84c82 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.161628 Aug 09 18:21:27.158292 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 297/571] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:26 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:21:28.184015 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-fcdc7c0b-03c0-433c-a517-251fcd75d187 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:28.184604 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-fcdc7c0b-03c0-433c-a517-251fcd75d187 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:28.191122 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fcdc7c0b-03c0-433c-a517-251fcd75d187 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:28.191606 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fcdc7c0b-03c0-433c-a517-251fcd75d187 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:28.192067 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fcdc7c0b-03c0-433c-a517-251fcd75d187 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:28.192934 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fcdc7c0b-03c0-433c-a517-251fcd75d187 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:28.193407 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fcdc7c0b-03c0-433c-a517-251fcd75d187 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:28.194193 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fcdc7c0b-03c0-433c-a517-251fcd75d187 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:28.327688 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-fcdc7c0b-03c0-433c-a517-251fcd75d187 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:28.336910 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-fcdc7c0b-03c0-433c-a517-251fcd75d187 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:28.338426 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-fcdc7c0b-03c0-433c-a517-251fcd75d187 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:28.339618 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-fcdc7c0b-03c0-433c-a517-251fcd75d187 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.159675 Aug 09 18:21:28.340192 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 275/572] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:28 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:21:29.367923 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-ff9c0deb-c0cc-41b2-874e-d064ec37a2f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:29.369247 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-ff9c0deb-c0cc-41b2-874e-d064ec37a2f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:29.375479 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ff9c0deb-c0cc-41b2-874e-d064ec37a2f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:29.376468 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ff9c0deb-c0cc-41b2-874e-d064ec37a2f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:29.377079 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ff9c0deb-c0cc-41b2-874e-d064ec37a2f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:29.377777 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ff9c0deb-c0cc-41b2-874e-d064ec37a2f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:29.378230 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ff9c0deb-c0cc-41b2-874e-d064ec37a2f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:29.378650 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ff9c0deb-c0cc-41b2-874e-d064ec37a2f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:29.513962 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ff9c0deb-c0cc-41b2-874e-d064ec37a2f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:29.522624 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ff9c0deb-c0cc-41b2-874e-d064ec37a2f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:29.524144 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ff9c0deb-c0cc-41b2-874e-d064ec37a2f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:29.525339 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-ff9c0deb-c0cc-41b2-874e-d064ec37a2f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.165956 Aug 09 18:21:29.525888 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 298/573] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:29 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:21:30.548240 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-a74c8681-53b2-4572-980c-f0195de9a001 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:30.548843 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-a74c8681-53b2-4572-980c-f0195de9a001 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:30.555589 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a74c8681-53b2-4572-980c-f0195de9a001 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:30.556068 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a74c8681-53b2-4572-980c-f0195de9a001 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:30.556496 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a74c8681-53b2-4572-980c-f0195de9a001 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:30.557173 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a74c8681-53b2-4572-980c-f0195de9a001 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:30.557619 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a74c8681-53b2-4572-980c-f0195de9a001 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:30.558034 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a74c8681-53b2-4572-980c-f0195de9a001 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:30.688564 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a74c8681-53b2-4572-980c-f0195de9a001 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:30.697389 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a74c8681-53b2-4572-980c-f0195de9a001 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:30.698944 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a74c8681-53b2-4572-980c-f0195de9a001 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:30.700090 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-a74c8681-53b2-4572-980c-f0195de9a001 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.155708 Aug 09 18:21:30.700643 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 276/574] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:30 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:21:31.593636 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d1e83d4c-1b14-43ff-b995-b112d0c72ff6 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:21:31.600881 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d1e83d4c-1b14-43ff-b995-b112d0c72ff6 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:31.601369 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d1e83d4c-1b14-43ff-b995-b112d0c72ff6 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:31.601808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d1e83d4c-1b14-43ff-b995-b112d0c72ff6 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:31.663352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d1e83d4c-1b14-43ff-b995-b112d0c72ff6 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Going to try to stop instance {{(pid=118313) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 18:21:31.722643 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-30a9669c-c58c-4d31-b0e8-51fe4551903b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:31.723210 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-30a9669c-c58c-4d31-b0e8-51fe4551903b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:31.730278 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-30a9669c-c58c-4d31-b0e8-51fe4551903b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:31.730794 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-30a9669c-c58c-4d31-b0e8-51fe4551903b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:31.731237 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-30a9669c-c58c-4d31-b0e8-51fe4551903b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:31.731927 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-30a9669c-c58c-4d31-b0e8-51fe4551903b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:31.732385 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-30a9669c-c58c-4d31-b0e8-51fe4551903b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:31.732841 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-30a9669c-c58c-4d31-b0e8-51fe4551903b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:31.814193 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d1e83d4c-1b14-43ff-b995-b112d0c72ff6 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "POST /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e/action" status: 202 len: 0 microversion: 2.1 time: 0.224277 Aug 09 18:21:31.814815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 299/575] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Aug 9 18:21:31 2022] POST /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:21:31.823203 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-eae79b8a-c540-407e-8bc4-3a57f4997f64 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:31.826968 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-eae79b8a-c540-407e-8bc4-3a57f4997f64 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:31.830443 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eae79b8a-c540-407e-8bc4-3a57f4997f64 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:31.830963 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eae79b8a-c540-407e-8bc4-3a57f4997f64 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:31.831396 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eae79b8a-c540-407e-8bc4-3a57f4997f64 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:31.832089 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eae79b8a-c540-407e-8bc4-3a57f4997f64 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:31.832539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eae79b8a-c540-407e-8bc4-3a57f4997f64 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:31.832959 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eae79b8a-c540-407e-8bc4-3a57f4997f64 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:31.867695 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-30a9669c-c58c-4d31-b0e8-51fe4551903b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:31.876357 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-30a9669c-c58c-4d31-b0e8-51fe4551903b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:31.877901 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-30a9669c-c58c-4d31-b0e8-51fe4551903b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:31.879120 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-30a9669c-c58c-4d31-b0e8-51fe4551903b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.160370 Aug 09 18:21:31.879680 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 277/576] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:31 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:21:31.963947 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-eae79b8a-c540-407e-8bc4-3a57f4997f64 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:31.971822 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-eae79b8a-c540-407e-8bc4-3a57f4997f64 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1724 microversion: 2.1 time: 0.152697 Aug 09 18:21:31.972380 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 300/577] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:31 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:21:32.902663 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-7dde5322-f7b6-44a4-808e-a689b12986d5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:32.903290 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-7dde5322-f7b6-44a4-808e-a689b12986d5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:32.909659 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7dde5322-f7b6-44a4-808e-a689b12986d5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:32.910160 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7dde5322-f7b6-44a4-808e-a689b12986d5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:32.910590 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7dde5322-f7b6-44a4-808e-a689b12986d5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:32.911800 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7dde5322-f7b6-44a4-808e-a689b12986d5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:32.912325 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7dde5322-f7b6-44a4-808e-a689b12986d5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:32.912746 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7dde5322-f7b6-44a4-808e-a689b12986d5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:32.993706 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-816e33aa-aac6-48b4-8715-e324e1168b4f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:32.994291 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-816e33aa-aac6-48b4-8715-e324e1168b4f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:33.000755 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-816e33aa-aac6-48b4-8715-e324e1168b4f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:33.001241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-816e33aa-aac6-48b4-8715-e324e1168b4f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:33.001674 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-816e33aa-aac6-48b4-8715-e324e1168b4f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:33.002365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-816e33aa-aac6-48b4-8715-e324e1168b4f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:33.002862 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-816e33aa-aac6-48b4-8715-e324e1168b4f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:33.003286 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-816e33aa-aac6-48b4-8715-e324e1168b4f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:33.055141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-7dde5322-f7b6-44a4-808e-a689b12986d5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:33.063497 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-7dde5322-f7b6-44a4-808e-a689b12986d5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:33.065068 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-7dde5322-f7b6-44a4-808e-a689b12986d5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:33.066283 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-7dde5322-f7b6-44a4-808e-a689b12986d5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.167542 Aug 09 18:21:33.066988 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 278/578] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:32 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:21:33.136677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-816e33aa-aac6-48b4-8715-e324e1168b4f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:33.144474 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-816e33aa-aac6-48b4-8715-e324e1168b4f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1724 microversion: 2.1 time: 0.155300 Aug 09 18:21:33.145052 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 301/579] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:32 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:21:34.031859 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-070007c4-ac97-4885-8526-7cc7b2746df3 req-fe723c7d-670c-43fc-82b1-ad2e74762def service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97", "name": "network-vif-plugged", "status": "completed", "tag": "be3a4bfe-af09-41a6-9567-0b2aabb83ff4"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:21:34.043205 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-070007c4-ac97-4885-8526-7cc7b2746df3 req-fe723c7d-670c-43fc-82b1-ad2e74762def service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:34.043714 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-070007c4-ac97-4885-8526-7cc7b2746df3 req-fe723c7d-670c-43fc-82b1-ad2e74762def service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:34.044145 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-070007c4-ac97-4885-8526-7cc7b2746df3 req-fe723c7d-670c-43fc-82b1-ad2e74762def service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:34.056283 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-070007c4-ac97-4885-8526-7cc7b2746df3 req-fe723c7d-670c-43fc-82b1-ad2e74762def service nova] Creating event network-vif-plugged:be3a4bfe-af09-41a6-9567-0b2aabb83ff4 for instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 on hv-cinder-79797 Aug 09 18:21:34.061332 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-070007c4-ac97-4885-8526-7cc7b2746df3 req-fe723c7d-670c-43fc-82b1-ad2e74762def service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089720 Aug 09 18:21:34.065200 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 279/580] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:21:34.089100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-ea1dfe28-343a-429a-9647-9fb2afd1e02a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:34.089708 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-ea1dfe28-343a-429a-9647-9fb2afd1e02a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:34.096374 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ea1dfe28-343a-429a-9647-9fb2afd1e02a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:34.097099 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ea1dfe28-343a-429a-9647-9fb2afd1e02a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:34.097693 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ea1dfe28-343a-429a-9647-9fb2afd1e02a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:34.098568 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ea1dfe28-343a-429a-9647-9fb2afd1e02a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:34.099579 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ea1dfe28-343a-429a-9647-9fb2afd1e02a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:34.100183 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ea1dfe28-343a-429a-9647-9fb2afd1e02a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:34.168879 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-9b9981fe-5d57-4907-9dd0-53cea1ba4771 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:34.168879 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-9b9981fe-5d57-4907-9dd0-53cea1ba4771 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:34.174216 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9b9981fe-5d57-4907-9dd0-53cea1ba4771 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:34.174939 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9b9981fe-5d57-4907-9dd0-53cea1ba4771 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:34.175379 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9b9981fe-5d57-4907-9dd0-53cea1ba4771 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:34.176073 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9b9981fe-5d57-4907-9dd0-53cea1ba4771 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:34.176528 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9b9981fe-5d57-4907-9dd0-53cea1ba4771 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:34.177627 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9b9981fe-5d57-4907-9dd0-53cea1ba4771 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:34.292623 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ea1dfe28-343a-429a-9647-9fb2afd1e02a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:34.302739 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ea1dfe28-343a-429a-9647-9fb2afd1e02a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:34.304574 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ea1dfe28-343a-429a-9647-9fb2afd1e02a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:34.305749 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-ea1dfe28-343a-429a-9647-9fb2afd1e02a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.220452 Aug 09 18:21:34.306326 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 302/581] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:34 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:21:34.336188 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-9b9981fe-5d57-4907-9dd0-53cea1ba4771 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:34.344226 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-9b9981fe-5d57-4907-9dd0-53cea1ba4771 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1724 microversion: 2.1 time: 0.181955 Aug 09 18:21:34.344788 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 280/582] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:34 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:21:35.329274 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2742e116-3f08-43fa-b365-ab548dee6890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:35.329883 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-2742e116-3f08-43fa-b365-ab548dee6890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:35.337246 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2742e116-3f08-43fa-b365-ab548dee6890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:35.337739 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2742e116-3f08-43fa-b365-ab548dee6890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:35.339156 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2742e116-3f08-43fa-b365-ab548dee6890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:35.339931 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2742e116-3f08-43fa-b365-ab548dee6890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:35.340461 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2742e116-3f08-43fa-b365-ab548dee6890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:35.340950 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2742e116-3f08-43fa-b365-ab548dee6890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:35.365849 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d546779a-698d-4e72-83fc-165ed56f49e3 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:35.366479 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d546779a-698d-4e72-83fc-165ed56f49e3 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:35.374426 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d546779a-698d-4e72-83fc-165ed56f49e3 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:35.374983 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d546779a-698d-4e72-83fc-165ed56f49e3 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:35.375421 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d546779a-698d-4e72-83fc-165ed56f49e3 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:35.376153 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d546779a-698d-4e72-83fc-165ed56f49e3 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:35.376635 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d546779a-698d-4e72-83fc-165ed56f49e3 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:35.377185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d546779a-698d-4e72-83fc-165ed56f49e3 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:35.594584 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-2742e116-3f08-43fa-b365-ab548dee6890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:35.609960 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-2742e116-3f08-43fa-b365-ab548dee6890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:35.611509 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d546779a-698d-4e72-83fc-165ed56f49e3 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:35.612198 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-2742e116-3f08-43fa-b365-ab548dee6890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:35.613869 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-2742e116-3f08-43fa-b365-ab548dee6890 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.288738 Aug 09 18:21:35.623780 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 303/583] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:35 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:21:35.628857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d546779a-698d-4e72-83fc-165ed56f49e3 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1724 microversion: 2.1 time: 0.265995 Aug 09 18:21:35.628857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 281/584] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:35 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:21:36.641382 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-42f1b68e-1cac-4fe5-80aa-64b5604646c3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:36.641987 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-42f1b68e-1cac-4fe5-80aa-64b5604646c3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:36.649168 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-42f1b68e-1cac-4fe5-80aa-64b5604646c3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:36.649651 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-42f1b68e-1cac-4fe5-80aa-64b5604646c3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:36.649970 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-fbbdf3f4-44ce-42f0-a706-6f6a5f80d0f8 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:36.650398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-42f1b68e-1cac-4fe5-80aa-64b5604646c3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:36.650607 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-fbbdf3f4-44ce-42f0-a706-6f6a5f80d0f8 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:36.650794 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-42f1b68e-1cac-4fe5-80aa-64b5604646c3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:36.651251 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-42f1b68e-1cac-4fe5-80aa-64b5604646c3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:36.651672 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-42f1b68e-1cac-4fe5-80aa-64b5604646c3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:36.657058 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fbbdf3f4-44ce-42f0-a706-6f6a5f80d0f8 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:36.657553 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fbbdf3f4-44ce-42f0-a706-6f6a5f80d0f8 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:36.657996 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fbbdf3f4-44ce-42f0-a706-6f6a5f80d0f8 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:36.658694 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fbbdf3f4-44ce-42f0-a706-6f6a5f80d0f8 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:36.659175 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fbbdf3f4-44ce-42f0-a706-6f6a5f80d0f8 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:36.659605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fbbdf3f4-44ce-42f0-a706-6f6a5f80d0f8 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:36.844403 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-42f1b68e-1cac-4fe5-80aa-64b5604646c3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:36.861190 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-fbbdf3f4-44ce-42f0-a706-6f6a5f80d0f8 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:36.868418 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-42f1b68e-1cac-4fe5-80aa-64b5604646c3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:36.869793 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-42f1b68e-1cac-4fe5-80aa-64b5604646c3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:36.870334 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-fbbdf3f4-44ce-42f0-a706-6f6a5f80d0f8 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1724 microversion: 2.1 time: 0.224967 Aug 09 18:21:36.871571 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 282/585] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:36 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:21:36.871701 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-42f1b68e-1cac-4fe5-80aa-64b5604646c3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.233487 Aug 09 18:21:36.872245 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 304/586] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:36 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:21:37.892720 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-17cefb3e-b80d-4eed-82d5-e4538f0a9aaf tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:37.893411 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-17cefb3e-b80d-4eed-82d5-e4538f0a9aaf tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:37.894390 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5f803ec0-36e1-4d4d-ac78-c292b225a0f8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:37.895037 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-5f803ec0-36e1-4d4d-ac78-c292b225a0f8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:37.901096 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-17cefb3e-b80d-4eed-82d5-e4538f0a9aaf tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:37.901554 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-17cefb3e-b80d-4eed-82d5-e4538f0a9aaf tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:37.902054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-17cefb3e-b80d-4eed-82d5-e4538f0a9aaf tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:37.902260 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5f803ec0-36e1-4d4d-ac78-c292b225a0f8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:37.902742 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5f803ec0-36e1-4d4d-ac78-c292b225a0f8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:37.902862 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-17cefb3e-b80d-4eed-82d5-e4538f0a9aaf tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:37.903180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5f803ec0-36e1-4d4d-ac78-c292b225a0f8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:37.903285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-17cefb3e-b80d-4eed-82d5-e4538f0a9aaf tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:37.903623 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-17cefb3e-b80d-4eed-82d5-e4538f0a9aaf tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:37.903876 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5f803ec0-36e1-4d4d-ac78-c292b225a0f8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:37.904358 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5f803ec0-36e1-4d4d-ac78-c292b225a0f8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:37.904785 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5f803ec0-36e1-4d4d-ac78-c292b225a0f8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:38.098900 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-17cefb3e-b80d-4eed-82d5-e4538f0a9aaf tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:38.105752 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-5f803ec0-36e1-4d4d-ac78-c292b225a0f8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:38.106891 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-17cefb3e-b80d-4eed-82d5-e4538f0a9aaf tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1724 microversion: 2.1 time: 0.217996 Aug 09 18:21:38.107463 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 283/587] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:37 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:21:38.115143 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-5f803ec0-36e1-4d4d-ac78-c292b225a0f8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:38.116954 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-5f803ec0-36e1-4d4d-ac78-c292b225a0f8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:38.118140 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-5f803ec0-36e1-4d4d-ac78-c292b225a0f8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1810 microversion: 2.20 time: 0.227605 Aug 09 18:21:38.124410 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 305/588] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:37 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1810 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:21:39.128209 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-15488f8b-c1bc-4d80-9908-7817d19c23b3 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:39.128821 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-15488f8b-c1bc-4d80-9908-7817d19c23b3 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:39.135353 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15488f8b-c1bc-4d80-9908-7817d19c23b3 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:39.135841 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15488f8b-c1bc-4d80-9908-7817d19c23b3 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:39.136275 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15488f8b-c1bc-4d80-9908-7817d19c23b3 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:39.136963 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15488f8b-c1bc-4d80-9908-7817d19c23b3 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:39.137418 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15488f8b-c1bc-4d80-9908-7817d19c23b3 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:39.137839 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15488f8b-c1bc-4d80-9908-7817d19c23b3 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:39.141118 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-09b25668-16a3-4e41-a0d4-c58031ddcab3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:39.141721 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-09b25668-16a3-4e41-a0d4-c58031ddcab3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:39.148863 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-09b25668-16a3-4e41-a0d4-c58031ddcab3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:39.149342 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-09b25668-16a3-4e41-a0d4-c58031ddcab3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:39.149772 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-09b25668-16a3-4e41-a0d4-c58031ddcab3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:39.150491 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-09b25668-16a3-4e41-a0d4-c58031ddcab3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:39.150964 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-09b25668-16a3-4e41-a0d4-c58031ddcab3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:39.151385 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-09b25668-16a3-4e41-a0d4-c58031ddcab3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:39.157028 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:21:39.335060 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-15488f8b-c1bc-4d80-9908-7817d19c23b3 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:39.344997 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-09b25668-16a3-4e41-a0d4-c58031ddcab3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:39.345330 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-15488f8b-c1bc-4d80-9908-7817d19c23b3 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1724 microversion: 2.1 time: 0.220907 Aug 09 18:21:39.345919 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 284/589] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:39 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:21:39.354043 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-09b25668-16a3-4e41-a0d4-c58031ddcab3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:39.355583 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-09b25668-16a3-4e41-a0d4-c58031ddcab3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:39.356731 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-09b25668-16a3-4e41-a0d4-c58031ddcab3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1797 microversion: 2.20 time: 0.219396 Aug 09 18:21:39.357278 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 306/590] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:21:39 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1797 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:21:40.367661 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-79001f23-7b91-46c6-baaa-c649fb97762b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:40.368273 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-79001f23-7b91-46c6-baaa-c649fb97762b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:40.374808 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79001f23-7b91-46c6-baaa-c649fb97762b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:40.375318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79001f23-7b91-46c6-baaa-c649fb97762b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:40.375749 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79001f23-7b91-46c6-baaa-c649fb97762b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:40.376428 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79001f23-7b91-46c6-baaa-c649fb97762b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:40.376876 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79001f23-7b91-46c6-baaa-c649fb97762b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:40.377296 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79001f23-7b91-46c6-baaa-c649fb97762b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:40.509651 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-79001f23-7b91-46c6-baaa-c649fb97762b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:40.517606 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-79001f23-7b91-46c6-baaa-c649fb97762b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1724 microversion: 2.1 time: 0.154756 Aug 09 18:21:40.518183 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 285/591] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:40 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:21:41.539493 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6c46bc19-6a58-4150-8c7c-b590280c25d7 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:41.540103 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-6c46bc19-6a58-4150-8c7c-b590280c25d7 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:41.546597 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6c46bc19-6a58-4150-8c7c-b590280c25d7 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:41.547116 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6c46bc19-6a58-4150-8c7c-b590280c25d7 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:41.547555 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6c46bc19-6a58-4150-8c7c-b590280c25d7 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:41.548284 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6c46bc19-6a58-4150-8c7c-b590280c25d7 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:41.548744 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6c46bc19-6a58-4150-8c7c-b590280c25d7 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:41.549169 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6c46bc19-6a58-4150-8c7c-b590280c25d7 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:41.675319 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6c46bc19-6a58-4150-8c7c-b590280c25d7 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:41.683993 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-6c46bc19-6a58-4150-8c7c-b590280c25d7 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1724 microversion: 2.1 time: 0.148319 Aug 09 18:21:41.684563 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 307/592] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:41 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:21:42.705157 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-fb88d921-e8cc-4cfe-b6ab-9dc66f5db64a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:42.705768 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-fb88d921-e8cc-4cfe-b6ab-9dc66f5db64a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:42.708142 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:21:42.713433 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fb88d921-e8cc-4cfe-b6ab-9dc66f5db64a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:42.713912 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fb88d921-e8cc-4cfe-b6ab-9dc66f5db64a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:42.714348 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fb88d921-e8cc-4cfe-b6ab-9dc66f5db64a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:42.715065 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fb88d921-e8cc-4cfe-b6ab-9dc66f5db64a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:42.715567 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fb88d921-e8cc-4cfe-b6ab-9dc66f5db64a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:42.715937 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fb88d921-e8cc-4cfe-b6ab-9dc66f5db64a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:42.844232 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-fb88d921-e8cc-4cfe-b6ab-9dc66f5db64a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:42.852146 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-fb88d921-e8cc-4cfe-b6ab-9dc66f5db64a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1724 microversion: 2.1 time: 0.150896 Aug 09 18:21:42.852704 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 286/593] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:42 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:21:43.873288 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-48e4c83c-060e-44e9-8f11-e1773c06224b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:43.874006 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-48e4c83c-060e-44e9-8f11-e1773c06224b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:43.881030 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-48e4c83c-060e-44e9-8f11-e1773c06224b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:43.881511 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-48e4c83c-060e-44e9-8f11-e1773c06224b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:43.881944 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-48e4c83c-060e-44e9-8f11-e1773c06224b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:43.882630 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-48e4c83c-060e-44e9-8f11-e1773c06224b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:43.883120 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-48e4c83c-060e-44e9-8f11-e1773c06224b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:43.883543 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-48e4c83c-060e-44e9-8f11-e1773c06224b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:44.219715 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-48e4c83c-060e-44e9-8f11-e1773c06224b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:44.228274 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-48e4c83c-060e-44e9-8f11-e1773c06224b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1724 microversion: 2.1 time: 0.358763 Aug 09 18:21:44.228835 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 308/594] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:43 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1724 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:21:45.249835 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-6ff9a0e9-8166-452a-bce3-f8888865ea41 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:45.250469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-6ff9a0e9-8166-452a-bce3-f8888865ea41 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:45.257127 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6ff9a0e9-8166-452a-bce3-f8888865ea41 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:45.263988 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6ff9a0e9-8166-452a-bce3-f8888865ea41 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:45.263988 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6ff9a0e9-8166-452a-bce3-f8888865ea41 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:45.263988 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6ff9a0e9-8166-452a-bce3-f8888865ea41 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:45.263988 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6ff9a0e9-8166-452a-bce3-f8888865ea41 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:45.264333 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6ff9a0e9-8166-452a-bce3-f8888865ea41 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:45.391038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-6ff9a0e9-8166-452a-bce3-f8888865ea41 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:45.399592 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-6ff9a0e9-8166-452a-bce3-f8888865ea41 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1724 microversion: 2.1 time: 0.153704 Aug 09 18:21:45.400150 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 287/595] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:45 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:21:46.420203 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-05d10e57-072e-4986-a9b1-df3d7d0659b5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:46.420870 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-05d10e57-072e-4986-a9b1-df3d7d0659b5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:46.428083 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-05d10e57-072e-4986-a9b1-df3d7d0659b5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:46.428570 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-05d10e57-072e-4986-a9b1-df3d7d0659b5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:46.429016 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-05d10e57-072e-4986-a9b1-df3d7d0659b5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:46.429795 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-05d10e57-072e-4986-a9b1-df3d7d0659b5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:46.430165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-05d10e57-072e-4986-a9b1-df3d7d0659b5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:46.430582 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-05d10e57-072e-4986-a9b1-df3d7d0659b5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:46.566262 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-05d10e57-072e-4986-a9b1-df3d7d0659b5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:46.574672 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-05d10e57-072e-4986-a9b1-df3d7d0659b5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1724 microversion: 2.1 time: 0.158325 Aug 09 18:21:46.575263 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 309/596] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:46 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:21:47.597017 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-456ea8f1-1ea1-4587-85ae-73bc4e1fc31c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:47.597626 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-456ea8f1-1ea1-4587-85ae-73bc4e1fc31c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:47.604679 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-456ea8f1-1ea1-4587-85ae-73bc4e1fc31c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:47.605168 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-456ea8f1-1ea1-4587-85ae-73bc4e1fc31c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:47.605610 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-456ea8f1-1ea1-4587-85ae-73bc4e1fc31c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:47.606302 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-456ea8f1-1ea1-4587-85ae-73bc4e1fc31c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:47.606790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-456ea8f1-1ea1-4587-85ae-73bc4e1fc31c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:47.607219 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-456ea8f1-1ea1-4587-85ae-73bc4e1fc31c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:47.734122 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-456ea8f1-1ea1-4587-85ae-73bc4e1fc31c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:47.743103 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-456ea8f1-1ea1-4587-85ae-73bc4e1fc31c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1724 microversion: 2.1 time: 0.149952 Aug 09 18:21:47.743672 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 288/597] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:47 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:21:48.763499 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d0ceeab4-8814-4563-8db1-66f99711a76b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:48.764154 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d0ceeab4-8814-4563-8db1-66f99711a76b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:48.770501 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d0ceeab4-8814-4563-8db1-66f99711a76b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:48.771070 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d0ceeab4-8814-4563-8db1-66f99711a76b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:48.771825 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d0ceeab4-8814-4563-8db1-66f99711a76b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:48.772638 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d0ceeab4-8814-4563-8db1-66f99711a76b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:48.773096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d0ceeab4-8814-4563-8db1-66f99711a76b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:48.773537 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d0ceeab4-8814-4563-8db1-66f99711a76b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:48.776155 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:21:48.905924 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d0ceeab4-8814-4563-8db1-66f99711a76b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:48.913825 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d0ceeab4-8814-4563-8db1-66f99711a76b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1724 microversion: 2.1 time: 0.154129 Aug 09 18:21:48.914398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 310/598] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:48 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:21:49.936182 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-9a20eef8-6d5f-42a3-9acb-219facd9c624 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:49.936783 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-9a20eef8-6d5f-42a3-9acb-219facd9c624 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:49.943933 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9a20eef8-6d5f-42a3-9acb-219facd9c624 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:49.944678 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9a20eef8-6d5f-42a3-9acb-219facd9c624 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:49.945245 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9a20eef8-6d5f-42a3-9acb-219facd9c624 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:49.946215 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9a20eef8-6d5f-42a3-9acb-219facd9c624 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:49.946723 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9a20eef8-6d5f-42a3-9acb-219facd9c624 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:49.947157 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9a20eef8-6d5f-42a3-9acb-219facd9c624 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:50.076720 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-9a20eef8-6d5f-42a3-9acb-219facd9c624 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:50.085141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-9a20eef8-6d5f-42a3-9acb-219facd9c624 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1701 microversion: 2.1 time: 0.152771 Aug 09 18:21:50.085702 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 289/599] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:49 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1701 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:21:50.105903 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5cd56361-e1f2-460a-a598-c8e7a8372c28 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:21:50.108241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=42 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:21:50.113288 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5cd56361-e1f2-460a-a598-c8e7a8372c28 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:50.113801 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5cd56361-e1f2-460a-a598-c8e7a8372c28 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:50.114243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5cd56361-e1f2-460a-a598-c8e7a8372c28 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:50.136284 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-5cd56361-e1f2-460a-a598-c8e7a8372c28 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Going to try to start instance {{(pid=118313) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 18:21:50.303068 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-5cd56361-e1f2-460a-a598-c8e7a8372c28 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "POST /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e/action" status: 202 len: 0 microversion: 2.1 time: 0.200606 Aug 09 18:21:50.303667 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 311/600] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Aug 9 18:21:50 2022] POST /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:21:50.311933 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e4b6e90a-46ad-4465-a322-4fa549ace9e5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:50.312621 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e4b6e90a-46ad-4465-a322-4fa549ace9e5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:50.319558 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e4b6e90a-46ad-4465-a322-4fa549ace9e5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:50.319945 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e4b6e90a-46ad-4465-a322-4fa549ace9e5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:50.320427 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e4b6e90a-46ad-4465-a322-4fa549ace9e5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:50.321110 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e4b6e90a-46ad-4465-a322-4fa549ace9e5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:50.321559 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e4b6e90a-46ad-4465-a322-4fa549ace9e5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:50.322003 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e4b6e90a-46ad-4465-a322-4fa549ace9e5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:50.457862 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e4b6e90a-46ad-4465-a322-4fa549ace9e5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:50.467435 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e4b6e90a-46ad-4465-a322-4fa549ace9e5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1710 microversion: 2.1 time: 0.159230 Aug 09 18:21:50.468015 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 290/601] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:50 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1710 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:21:51.490119 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-aa8b8fde-7b61-415c-b6f7-1fccada33349 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:51.491011 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-aa8b8fde-7b61-415c-b6f7-1fccada33349 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:51.497034 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-aa8b8fde-7b61-415c-b6f7-1fccada33349 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:51.497516 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-aa8b8fde-7b61-415c-b6f7-1fccada33349 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:51.497951 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-aa8b8fde-7b61-415c-b6f7-1fccada33349 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:51.498624 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-aa8b8fde-7b61-415c-b6f7-1fccada33349 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:51.499097 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-aa8b8fde-7b61-415c-b6f7-1fccada33349 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:51.499515 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-aa8b8fde-7b61-415c-b6f7-1fccada33349 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:51.629958 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-aa8b8fde-7b61-415c-b6f7-1fccada33349 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:51.638542 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-aa8b8fde-7b61-415c-b6f7-1fccada33349 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1710 microversion: 2.1 time: 0.153527 Aug 09 18:21:51.639135 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 312/602] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:51 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1710 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:21:52.660469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-316505fd-0ed9-4a84-b83b-d16e83d878db tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:52.661073 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-316505fd-0ed9-4a84-b83b-d16e83d878db tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:52.667794 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-316505fd-0ed9-4a84-b83b-d16e83d878db tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:52.668278 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-316505fd-0ed9-4a84-b83b-d16e83d878db tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:52.668740 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-316505fd-0ed9-4a84-b83b-d16e83d878db tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:52.669431 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-316505fd-0ed9-4a84-b83b-d16e83d878db tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:52.669880 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-316505fd-0ed9-4a84-b83b-d16e83d878db tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:52.670299 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-316505fd-0ed9-4a84-b83b-d16e83d878db tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:52.801069 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-316505fd-0ed9-4a84-b83b-d16e83d878db tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:52.809923 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-316505fd-0ed9-4a84-b83b-d16e83d878db tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1714 microversion: 2.1 time: 0.153309 Aug 09 18:21:52.810533 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 291/603] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:52 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1714 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:21:59.098691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d46f0f29-0ebf-430e-b9c8-e274b06ebf58 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "592eb6ec-81ff-43f0-8498-244b5aaa5422"}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:21:59.102888 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d46f0f29-0ebf-430e-b9c8-e274b06ebf58 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:59.107844 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d46f0f29-0ebf-430e-b9c8-e274b06ebf58 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:59.108318 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d46f0f29-0ebf-430e-b9c8-e274b06ebf58 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:59.108746 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d46f0f29-0ebf-430e-b9c8-e274b06ebf58 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:59.109430 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d46f0f29-0ebf-430e-b9c8-e274b06ebf58 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:59.109882 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d46f0f29-0ebf-430e-b9c8-e274b06ebf58 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:59.110302 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d46f0f29-0ebf-430e-b9c8-e274b06ebf58 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:59.824304 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d46f0f29-0ebf-430e-b9c8-e274b06ebf58 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "POST /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.889555 Aug 09 18:21:59.825033 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 313/604] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Aug 9 18:21:58 2022] POST /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655/os-volume_attachments => generated 194 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:22:08.408176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-66227b5c-67de-4aeb-9eb4-12d2efb2637d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:22:08.410592 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-66227b5c-67de-4aeb-9eb4-12d2efb2637d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:08.412784 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=11 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:22:08.415263 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=44 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:22:08.418178 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-66227b5c-67de-4aeb-9eb4-12d2efb2637d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:08.418660 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-66227b5c-67de-4aeb-9eb4-12d2efb2637d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:08.419122 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-66227b5c-67de-4aeb-9eb4-12d2efb2637d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:08.419852 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-66227b5c-67de-4aeb-9eb4-12d2efb2637d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:08.420302 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-66227b5c-67de-4aeb-9eb4-12d2efb2637d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:08.420717 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-66227b5c-67de-4aeb-9eb4-12d2efb2637d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:08.444332 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.objects.instance [None req-66227b5c-67de-4aeb-9eb4-12d2efb2637d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lazy-loading 'flavor' on Instance uuid 245f64c6-0159-4c0d-816e-8cd5213fd655 {{(pid=118314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:22:08.788772 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-66227b5c-67de-4aeb-9eb4-12d2efb2637d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "POST /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655/action" status: 200 len: 32 microversion: 2.1 time: 0.384471 Aug 09 18:22:08.789456 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 292/605] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Aug 9 18:22:08 2022] POST /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655/action => generated 32 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 18:22:08.803428 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-cad6378c-ab3c-4073-be1d-03f80a143ec9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:08.804181 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-cad6378c-ab3c-4073-be1d-03f80a143ec9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:08.811743 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cad6378c-ab3c-4073-be1d-03f80a143ec9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:08.812225 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cad6378c-ab3c-4073-be1d-03f80a143ec9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:08.812653 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cad6378c-ab3c-4073-be1d-03f80a143ec9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:08.813347 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cad6378c-ab3c-4073-be1d-03f80a143ec9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:08.813795 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cad6378c-ab3c-4073-be1d-03f80a143ec9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:08.814217 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cad6378c-ab3c-4073-be1d-03f80a143ec9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:09.043970 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-cad6378c-ab3c-4073-be1d-03f80a143ec9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:09.051969 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-cad6378c-ab3c-4073-be1d-03f80a143ec9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1735 microversion: 2.1 time: 0.253185 Aug 09 18:22:09.052559 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 314/606] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:08 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1735 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:10.077077 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-07e3e898-cc74-4a41-8cc6-6411a8c503a7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:10.078054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-07e3e898-cc74-4a41-8cc6-6411a8c503a7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:10.085296 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-07e3e898-cc74-4a41-8cc6-6411a8c503a7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:10.087209 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-07e3e898-cc74-4a41-8cc6-6411a8c503a7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:10.089842 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-07e3e898-cc74-4a41-8cc6-6411a8c503a7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:10.090627 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-07e3e898-cc74-4a41-8cc6-6411a8c503a7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:10.091126 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-07e3e898-cc74-4a41-8cc6-6411a8c503a7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:10.091553 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-07e3e898-cc74-4a41-8cc6-6411a8c503a7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:10.229426 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-07e3e898-cc74-4a41-8cc6-6411a8c503a7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:10.238152 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-07e3e898-cc74-4a41-8cc6-6411a8c503a7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1735 microversion: 2.1 time: 0.167431 Aug 09 18:22:10.238748 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 293/607] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:10 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:11.260996 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-3f416ff4-8c64-4ede-880e-37b0c6cc0898 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:11.261635 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-3f416ff4-8c64-4ede-880e-37b0c6cc0898 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:11.268183 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3f416ff4-8c64-4ede-880e-37b0c6cc0898 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:11.268668 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3f416ff4-8c64-4ede-880e-37b0c6cc0898 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:11.269322 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3f416ff4-8c64-4ede-880e-37b0c6cc0898 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:11.270022 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3f416ff4-8c64-4ede-880e-37b0c6cc0898 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:11.270479 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3f416ff4-8c64-4ede-880e-37b0c6cc0898 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:11.270934 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3f416ff4-8c64-4ede-880e-37b0c6cc0898 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:11.419917 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-3f416ff4-8c64-4ede-880e-37b0c6cc0898 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:11.428460 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-3f416ff4-8c64-4ede-880e-37b0c6cc0898 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1735 microversion: 2.1 time: 0.171893 Aug 09 18:22:11.429044 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 315/608] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:11 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:12.449394 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e778daab-aec0-429b-9891-207d97af1c76 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:12.450031 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e778daab-aec0-429b-9891-207d97af1c76 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:12.456721 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e778daab-aec0-429b-9891-207d97af1c76 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:12.457449 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e778daab-aec0-429b-9891-207d97af1c76 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:12.457886 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e778daab-aec0-429b-9891-207d97af1c76 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:12.459189 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e778daab-aec0-429b-9891-207d97af1c76 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:12.459914 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e778daab-aec0-429b-9891-207d97af1c76 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:12.460578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e778daab-aec0-429b-9891-207d97af1c76 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:12.634845 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e778daab-aec0-429b-9891-207d97af1c76 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:12.643199 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e778daab-aec0-429b-9891-207d97af1c76 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1735 microversion: 2.1 time: 0.197610 Aug 09 18:22:12.644228 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 294/609] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:12 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1735 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:13.667532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9b41f8c4-6a8b-41fa-96ba-e626f66685e8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:13.668288 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9b41f8c4-6a8b-41fa-96ba-e626f66685e8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:13.675626 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9b41f8c4-6a8b-41fa-96ba-e626f66685e8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:13.676112 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9b41f8c4-6a8b-41fa-96ba-e626f66685e8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:13.676594 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9b41f8c4-6a8b-41fa-96ba-e626f66685e8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:13.677290 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9b41f8c4-6a8b-41fa-96ba-e626f66685e8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:13.677792 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9b41f8c4-6a8b-41fa-96ba-e626f66685e8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:13.678543 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9b41f8c4-6a8b-41fa-96ba-e626f66685e8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:13.834586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9b41f8c4-6a8b-41fa-96ba-e626f66685e8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:13.843825 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9b41f8c4-6a8b-41fa-96ba-e626f66685e8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1735 microversion: 2.1 time: 0.180750 Aug 09 18:22:13.844594 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 316/610] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:13 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:14.866117 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-34f98e19-a5ba-4a79-a26f-0a7211ba388f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:14.866941 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-34f98e19-a5ba-4a79-a26f-0a7211ba388f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:14.874469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-34f98e19-a5ba-4a79-a26f-0a7211ba388f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:14.875892 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-34f98e19-a5ba-4a79-a26f-0a7211ba388f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:14.877121 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-34f98e19-a5ba-4a79-a26f-0a7211ba388f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:14.878059 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-34f98e19-a5ba-4a79-a26f-0a7211ba388f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:14.878926 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-34f98e19-a5ba-4a79-a26f-0a7211ba388f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:14.879596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-34f98e19-a5ba-4a79-a26f-0a7211ba388f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:15.026809 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-34f98e19-a5ba-4a79-a26f-0a7211ba388f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:15.036400 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-34f98e19-a5ba-4a79-a26f-0a7211ba388f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1735 microversion: 2.1 time: 0.174194 Aug 09 18:22:15.043372 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 295/611] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:14 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:16.057566 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d475fb95-d716-4e65-a738-3c95f04e91f7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:16.058162 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d475fb95-d716-4e65-a738-3c95f04e91f7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:16.064130 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d475fb95-d716-4e65-a738-3c95f04e91f7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:16.064610 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d475fb95-d716-4e65-a738-3c95f04e91f7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:16.065045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d475fb95-d716-4e65-a738-3c95f04e91f7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:16.065722 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d475fb95-d716-4e65-a738-3c95f04e91f7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:16.066170 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d475fb95-d716-4e65-a738-3c95f04e91f7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:16.066588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d475fb95-d716-4e65-a738-3c95f04e91f7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:16.208952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d475fb95-d716-4e65-a738-3c95f04e91f7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:16.216800 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d475fb95-d716-4e65-a738-3c95f04e91f7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1735 microversion: 2.1 time: 0.163865 Aug 09 18:22:16.217359 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 317/612] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:16 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:16.590988 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:22:16.591572 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Tue Aug 9 18:22:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:22:17.238922 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e5f0c0d5-e6fe-47a7-93b7-c0fa95645157 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:17.239529 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e5f0c0d5-e6fe-47a7-93b7-c0fa95645157 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:17.248104 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e5f0c0d5-e6fe-47a7-93b7-c0fa95645157 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:17.248623 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e5f0c0d5-e6fe-47a7-93b7-c0fa95645157 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:17.249080 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e5f0c0d5-e6fe-47a7-93b7-c0fa95645157 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:17.249861 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e5f0c0d5-e6fe-47a7-93b7-c0fa95645157 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:17.250315 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e5f0c0d5-e6fe-47a7-93b7-c0fa95645157 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:17.250775 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e5f0c0d5-e6fe-47a7-93b7-c0fa95645157 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:17.426191 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e5f0c0d5-e6fe-47a7-93b7-c0fa95645157 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:17.435046 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e5f0c0d5-e6fe-47a7-93b7-c0fa95645157 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1735 microversion: 2.1 time: 0.200131 Aug 09 18:22:17.435635 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 296/613] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:17 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:18.458318 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-72439aa6-d585-4705-8358-c8f70b52c7bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:18.459534 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-72439aa6-d585-4705-8358-c8f70b52c7bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:18.479339 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-72439aa6-d585-4705-8358-c8f70b52c7bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:18.480398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-72439aa6-d585-4705-8358-c8f70b52c7bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:18.480980 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-72439aa6-d585-4705-8358-c8f70b52c7bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:18.482791 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-72439aa6-d585-4705-8358-c8f70b52c7bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:18.483360 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-72439aa6-d585-4705-8358-c8f70b52c7bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:18.484149 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-72439aa6-d585-4705-8358-c8f70b52c7bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:18.704349 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-72439aa6-d585-4705-8358-c8f70b52c7bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:18.713606 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-72439aa6-d585-4705-8358-c8f70b52c7bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1735 microversion: 2.1 time: 0.259478 Aug 09 18:22:18.719622 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 318/614] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:18 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1735 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:19.737708 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-b2b21ba0-93f9-4830-bf6f-5a4849c8bc85 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:19.738934 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-b2b21ba0-93f9-4830-bf6f-5a4849c8bc85 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:19.746545 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b2b21ba0-93f9-4830-bf6f-5a4849c8bc85 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:19.747060 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b2b21ba0-93f9-4830-bf6f-5a4849c8bc85 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:19.747492 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b2b21ba0-93f9-4830-bf6f-5a4849c8bc85 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:19.748186 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b2b21ba0-93f9-4830-bf6f-5a4849c8bc85 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:19.748637 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b2b21ba0-93f9-4830-bf6f-5a4849c8bc85 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:19.749057 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b2b21ba0-93f9-4830-bf6f-5a4849c8bc85 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:19.907140 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-b2b21ba0-93f9-4830-bf6f-5a4849c8bc85 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:19.920941 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-b2b21ba0-93f9-4830-bf6f-5a4849c8bc85 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1735 microversion: 2.1 time: 0.187040 Aug 09 18:22:19.922070 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 297/615] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:19 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:20.943378 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a0243885-7d19-4bbb-98c2-dd4cba3557fb tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:20.944021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a0243885-7d19-4bbb-98c2-dd4cba3557fb tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:20.946607 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=16 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:22:20.951300 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a0243885-7d19-4bbb-98c2-dd4cba3557fb tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:20.951755 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a0243885-7d19-4bbb-98c2-dd4cba3557fb tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:20.952190 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a0243885-7d19-4bbb-98c2-dd4cba3557fb tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:20.952887 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a0243885-7d19-4bbb-98c2-dd4cba3557fb tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:20.953347 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a0243885-7d19-4bbb-98c2-dd4cba3557fb tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:20.953772 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a0243885-7d19-4bbb-98c2-dd4cba3557fb tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:20.957793 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:22:21.092532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a0243885-7d19-4bbb-98c2-dd4cba3557fb tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:21.103556 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a0243885-7d19-4bbb-98c2-dd4cba3557fb tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1735 microversion: 2.1 time: 0.163824 Aug 09 18:22:21.112180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 319/616] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:20 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:22.128242 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-0d640d62-6b2f-429b-80d5-c205f16ad1c7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:22.128974 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-0d640d62-6b2f-429b-80d5-c205f16ad1c7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:22.138269 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0d640d62-6b2f-429b-80d5-c205f16ad1c7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:22.138921 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0d640d62-6b2f-429b-80d5-c205f16ad1c7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:22.139311 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0d640d62-6b2f-429b-80d5-c205f16ad1c7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:22.140660 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0d640d62-6b2f-429b-80d5-c205f16ad1c7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:22.140660 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0d640d62-6b2f-429b-80d5-c205f16ad1c7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:22.141107 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0d640d62-6b2f-429b-80d5-c205f16ad1c7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:22.307969 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-0d640d62-6b2f-429b-80d5-c205f16ad1c7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:22.320135 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-0d640d62-6b2f-429b-80d5-c205f16ad1c7 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1735 microversion: 2.1 time: 0.198395 Aug 09 18:22:22.320632 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 298/617] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:22 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:23.342458 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d80fe4fa-dc1f-4139-a910-72ba5e53b620 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:23.343185 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d80fe4fa-dc1f-4139-a910-72ba5e53b620 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:23.355643 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d80fe4fa-dc1f-4139-a910-72ba5e53b620 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:23.356225 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d80fe4fa-dc1f-4139-a910-72ba5e53b620 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:23.356728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d80fe4fa-dc1f-4139-a910-72ba5e53b620 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:23.357497 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d80fe4fa-dc1f-4139-a910-72ba5e53b620 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:23.358040 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d80fe4fa-dc1f-4139-a910-72ba5e53b620 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:23.358519 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d80fe4fa-dc1f-4139-a910-72ba5e53b620 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:23.530073 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d80fe4fa-dc1f-4139-a910-72ba5e53b620 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:23.546631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d80fe4fa-dc1f-4139-a910-72ba5e53b620 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1735 microversion: 2.1 time: 0.207814 Aug 09 18:22:23.549519 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 320/618] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:23 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:22:24.571206 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-a25eed74-0207-4cd9-bbbf-806b77615488 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:24.571942 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-a25eed74-0207-4cd9-bbbf-806b77615488 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:24.580506 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a25eed74-0207-4cd9-bbbf-806b77615488 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:24.581338 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a25eed74-0207-4cd9-bbbf-806b77615488 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:24.581846 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a25eed74-0207-4cd9-bbbf-806b77615488 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:24.582617 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a25eed74-0207-4cd9-bbbf-806b77615488 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:24.583170 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a25eed74-0207-4cd9-bbbf-806b77615488 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:24.583696 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a25eed74-0207-4cd9-bbbf-806b77615488 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:24.730654 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a25eed74-0207-4cd9-bbbf-806b77615488 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:24.740176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-a25eed74-0207-4cd9-bbbf-806b77615488 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1735 microversion: 2.1 time: 0.172789 Aug 09 18:22:24.751096 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 299/619] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:24 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:25.765081 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-58c74597-1a37-456b-aacc-b0ba5ca58fbf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:25.765685 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-58c74597-1a37-456b-aacc-b0ba5ca58fbf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:25.773831 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-58c74597-1a37-456b-aacc-b0ba5ca58fbf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:25.775090 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-58c74597-1a37-456b-aacc-b0ba5ca58fbf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:25.775950 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-58c74597-1a37-456b-aacc-b0ba5ca58fbf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:25.776982 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-58c74597-1a37-456b-aacc-b0ba5ca58fbf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:25.777595 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-58c74597-1a37-456b-aacc-b0ba5ca58fbf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:25.778197 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-58c74597-1a37-456b-aacc-b0ba5ca58fbf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:25.925668 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-58c74597-1a37-456b-aacc-b0ba5ca58fbf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:25.937208 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-58c74597-1a37-456b-aacc-b0ba5ca58fbf tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1735 microversion: 2.1 time: 0.176244 Aug 09 18:22:25.939009 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 321/620] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:25 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:26.960124 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-77ecd674-44b7-428c-b003-3448dc566652 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:26.960735 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-77ecd674-44b7-428c-b003-3448dc566652 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:26.971851 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-77ecd674-44b7-428c-b003-3448dc566652 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:26.972544 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-77ecd674-44b7-428c-b003-3448dc566652 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:26.972977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-77ecd674-44b7-428c-b003-3448dc566652 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:26.973672 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-77ecd674-44b7-428c-b003-3448dc566652 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:26.974122 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-77ecd674-44b7-428c-b003-3448dc566652 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:26.974534 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-77ecd674-44b7-428c-b003-3448dc566652 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:27.139323 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-77ecd674-44b7-428c-b003-3448dc566652 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:27.149399 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-77ecd674-44b7-428c-b003-3448dc566652 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1735 microversion: 2.1 time: 0.192643 Aug 09 18:22:27.149975 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 300/621] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:26 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:28.171076 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d8d5ecb1-7495-4eb5-8b3a-6f851d33f4cc tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:28.171632 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d8d5ecb1-7495-4eb5-8b3a-6f851d33f4cc tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:28.178008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d8d5ecb1-7495-4eb5-8b3a-6f851d33f4cc tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:28.178490 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d8d5ecb1-7495-4eb5-8b3a-6f851d33f4cc tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:28.178972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d8d5ecb1-7495-4eb5-8b3a-6f851d33f4cc tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:28.179645 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d8d5ecb1-7495-4eb5-8b3a-6f851d33f4cc tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:28.180745 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d8d5ecb1-7495-4eb5-8b3a-6f851d33f4cc tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:28.181208 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d8d5ecb1-7495-4eb5-8b3a-6f851d33f4cc tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:28.325528 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d8d5ecb1-7495-4eb5-8b3a-6f851d33f4cc tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:28.333395 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d8d5ecb1-7495-4eb5-8b3a-6f851d33f4cc tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1735 microversion: 2.1 time: 0.166267 Aug 09 18:22:28.333965 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 322/622] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:28 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:29.356395 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-80c7f6c2-9f3a-4be3-a26c-d517271bb95d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:29.357650 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-80c7f6c2-9f3a-4be3-a26c-d517271bb95d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:29.364308 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-80c7f6c2-9f3a-4be3-a26c-d517271bb95d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:29.365075 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-80c7f6c2-9f3a-4be3-a26c-d517271bb95d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:29.365932 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-80c7f6c2-9f3a-4be3-a26c-d517271bb95d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:29.366735 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-80c7f6c2-9f3a-4be3-a26c-d517271bb95d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:29.367406 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-80c7f6c2-9f3a-4be3-a26c-d517271bb95d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:29.368158 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-80c7f6c2-9f3a-4be3-a26c-d517271bb95d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:29.561085 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-80c7f6c2-9f3a-4be3-a26c-d517271bb95d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:29.570158 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-80c7f6c2-9f3a-4be3-a26c-d517271bb95d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1735 microversion: 2.1 time: 0.218311 Aug 09 18:22:29.571366 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 301/623] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:29 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1735 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:30.595053 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-92a4af6c-897e-4e34-844f-643301b35d7c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:30.596400 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-92a4af6c-897e-4e34-844f-643301b35d7c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:30.603302 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-92a4af6c-897e-4e34-844f-643301b35d7c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:30.604141 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-92a4af6c-897e-4e34-844f-643301b35d7c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:30.604828 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-92a4af6c-897e-4e34-844f-643301b35d7c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:30.605625 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-92a4af6c-897e-4e34-844f-643301b35d7c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:30.606153 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-92a4af6c-897e-4e34-844f-643301b35d7c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:30.606665 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-92a4af6c-897e-4e34-844f-643301b35d7c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:30.754493 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-92a4af6c-897e-4e34-844f-643301b35d7c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:30.763937 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-92a4af6c-897e-4e34-844f-643301b35d7c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1735 microversion: 2.1 time: 0.173052 Aug 09 18:22:30.772239 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 323/624] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:30 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:31.789283 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-603a8cd5-0011-4b2f-a4e0-79876e4e2942 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:31.791562 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-603a8cd5-0011-4b2f-a4e0-79876e4e2942 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:31.798311 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-603a8cd5-0011-4b2f-a4e0-79876e4e2942 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:31.798941 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-603a8cd5-0011-4b2f-a4e0-79876e4e2942 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:31.799624 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-603a8cd5-0011-4b2f-a4e0-79876e4e2942 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:31.800545 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-603a8cd5-0011-4b2f-a4e0-79876e4e2942 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:31.801311 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-603a8cd5-0011-4b2f-a4e0-79876e4e2942 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:31.801948 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-603a8cd5-0011-4b2f-a4e0-79876e4e2942 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:31.950184 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-603a8cd5-0011-4b2f-a4e0-79876e4e2942 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:31.958624 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-603a8cd5-0011-4b2f-a4e0-79876e4e2942 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1735 microversion: 2.1 time: 0.174711 Aug 09 18:22:31.959581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 302/625] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:31 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:32.604695 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2b6a2ea6-4ad0-4f1b-9ec6-3ac293802f21 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Action: 'create', calling method: .version_select at 0x7f4c3535a820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1160722648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3p97MhL9Qb6L+CPtaPmWQsplfpoO30uDveXYsUIoC5TskYij09MvTKgX29uxDHNH0irgGcJxeyQk8JuKUXM174ibo3cleuE6Sm1fcBU09CccC6/zB0qdhKMbNdCJtqtg=="}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:22:32.627642 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-2b6a2ea6-4ad0-4f1b-9ec6-3ac293802f21 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Getting quotas for project d793302181944f85ade371ded12ca4c4. Resources: {'key_pairs'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:22:32.631234 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-2b6a2ea6-4ad0-4f1b-9ec6-3ac293802f21 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Getting quotas for user 5f4eeae86db248a09f0725ca23ac6a9f and project d793302181944f85ade371ded12ca4c4. Resources: {'key_pairs'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:22:32.749049 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-2b6a2ea6-4ad0-4f1b-9ec6-3ac293802f21 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.148273 Aug 09 18:22:32.749697 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 324/626] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Aug 9 18:22:32 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:22:32.799713 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f9570726-3224-4c40-9a19-3d1413f44ddb tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1541496424", "imageRef": "e70a0a35-1fed-49fe-a6ac-e3adb705b305", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1160722648", "networks": [{"uuid": "7102f2a7-f024-4750-934c-e773a8776eb6"}]}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:22:32.851070 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.network.neutron [None req-f9570726-3224-4c40-9a19-3d1413f44ddb tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] validate_networks() for [('7102f2a7-f024-4750-934c-e773a8776eb6', None, None, None, None, None)] {{(pid=118314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:22:32.981313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-cab06ef4-2976-4596-81b9-d19b47c820ca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:32.981923 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-cab06ef4-2976-4596-81b9-d19b47c820ca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:32.988425 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cab06ef4-2976-4596-81b9-d19b47c820ca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:32.988988 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cab06ef4-2976-4596-81b9-d19b47c820ca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:32.989428 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cab06ef4-2976-4596-81b9-d19b47c820ca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:32.990145 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cab06ef4-2976-4596-81b9-d19b47c820ca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:32.990659 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cab06ef4-2976-4596-81b9-d19b47c820ca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:32.991108 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cab06ef4-2976-4596-81b9-d19b47c820ca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:33.129400 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-cab06ef4-2976-4596-81b9-d19b47c820ca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:33.137498 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-cab06ef4-2976-4596-81b9-d19b47c820ca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1735 microversion: 2.1 time: 0.160870 Aug 09 18:22:33.138051 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 325/627] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:32 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:22:33.334797 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-f9570726-3224-4c40-9a19-3d1413f44ddb tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Flavor limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:22:33.334797 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-f9570726-3224-4c40-9a19-3d1413f44ddb tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Image limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:22:33.334797 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-f9570726-3224-4c40-9a19-3d1413f44ddb tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Flavor pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:22:33.335106 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-f9570726-3224-4c40-9a19-3d1413f44ddb tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Image pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:22:33.335344 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-f9570726-3224-4c40-9a19-3d1413f44ddb tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:22:33.345064 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f9570726-3224-4c40-9a19-3d1413f44ddb tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:33.345545 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f9570726-3224-4c40-9a19-3d1413f44ddb tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:33.345975 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f9570726-3224-4c40-9a19-3d1413f44ddb tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:33.346831 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f9570726-3224-4c40-9a19-3d1413f44ddb tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:33.347303 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f9570726-3224-4c40-9a19-3d1413f44ddb tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:33.347724 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f9570726-3224-4c40-9a19-3d1413f44ddb tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:33.366813 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-f9570726-3224-4c40-9a19-3d1413f44ddb tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Getting quotas for project d793302181944f85ade371ded12ca4c4. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:22:33.371834 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-f9570726-3224-4c40-9a19-3d1413f44ddb tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Getting quotas for user 5f4eeae86db248a09f0725ca23ac6a9f and project d793302181944f85ade371ded12ca4c4. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:22:33.382838 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f9570726-3224-4c40-9a19-3d1413f44ddb tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Going to run 1 instances... {{(pid=118314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:22:33.385693 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f9570726-3224-4c40-9a19-3d1413f44ddb tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e70a0a35-1fed-49fe-a6ac-e3adb705b305',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:22:33.489438 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f9570726-3224-4c40-9a19-3d1413f44ddb tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693500 Aug 09 18:22:33.490160 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 303/628] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Aug 9 18:22:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:22:33.500907 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f63c41db-6dd1-4d24-8d1a-f40744701ce0 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:33.501600 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f63c41db-6dd1-4d24-8d1a-f40744701ce0 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:33.555001 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f63c41db-6dd1-4d24-8d1a-f40744701ce0 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:33.562156 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f63c41db-6dd1-4d24-8d1a-f40744701ce0 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1259 microversion: 2.1 time: 0.065073 Aug 09 18:22:33.565200 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 326/629] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:33 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1259 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:34.160856 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-df611b1a-9aaf-4037-93aa-c38b7174df05 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:34.161394 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-df611b1a-9aaf-4037-93aa-c38b7174df05 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:34.169103 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-df611b1a-9aaf-4037-93aa-c38b7174df05 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:34.171103 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-df611b1a-9aaf-4037-93aa-c38b7174df05 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:34.171103 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-df611b1a-9aaf-4037-93aa-c38b7174df05 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:34.171103 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-df611b1a-9aaf-4037-93aa-c38b7174df05 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:34.171567 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-df611b1a-9aaf-4037-93aa-c38b7174df05 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:34.171567 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-df611b1a-9aaf-4037-93aa-c38b7174df05 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:34.307267 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-df611b1a-9aaf-4037-93aa-c38b7174df05 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:34.315306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-df611b1a-9aaf-4037-93aa-c38b7174df05 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1715 microversion: 2.1 time: 0.158818 Aug 09 18:22:34.315880 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 304/630] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:34 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1715 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:34.425703 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9c32552a-2e98-4635-b267-901329da21bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:34.426209 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9c32552a-2e98-4635-b267-901329da21bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:34.434106 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9c32552a-2e98-4635-b267-901329da21bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:34.435130 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9c32552a-2e98-4635-b267-901329da21bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:34.435130 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9c32552a-2e98-4635-b267-901329da21bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:34.435761 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9c32552a-2e98-4635-b267-901329da21bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:34.436223 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9c32552a-2e98-4635-b267-901329da21bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:34.436652 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9c32552a-2e98-4635-b267-901329da21bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:34.519650 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-9c32552a-2e98-4635-b267-901329da21bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] HTTP exception thrown: Cannot 'detach_volume' instance 245f64c6-0159-4c0d-816e-8cd5213fd655 while it is in vm_state rescued Aug 09 18:22:34.521243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9c32552a-2e98-4635-b267-901329da21bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Request method failure captured: Aug 09 18:22:34.521243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: DELETE /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655/os-volume_attachments/592eb6ec-81ff-43f0-8498-244b5aaa5422 HTTP/1.1 Aug 09 18:22:34.521243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:22:34.521243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:22:34.521243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:22:34.521243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:22:34.521243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:22:34.521243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:22:34.521243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:22:34.521243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:22:34.521243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qRIOR_EAMdUNpksmgwcf99FOSSqhVI8tsoIxh3BjiMzTfrXpYksm4wl0XX75hcX4zSB7VEWBHIFqhlPU6iolaNft99hftdwd5BJh27Wa4fHll0E3coSOe8qDBsNwpnORq82KDHpkxKtU9qWPAuGjeYDz1tW8ACtpXpu2MbvQ0yJQ-Q Aug 09 18:22:34.521243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:22:34.521243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:22:34.521243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:22:34.521243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:22:34.521243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:22:34.521243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:22:34.521243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: dbd7e50444cc4ef0873bfac9d9a2d514 Aug 09 18:22:34.521243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-460293175 Aug 09 18:22:34.521243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:22:34.521243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:22:34.528564 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dbd7e50444cc4ef0873bfac9d9a2d514"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dbd7e50444cc4ef0873bfac9d9a2d514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dbd7e50444cc4ef0873bfac9d9a2d514", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dbd7e50444cc4ef0873bfac9d9a2d514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:22:34.528564 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-ServerRescueNegativeTestJSON-460293175 Aug 09 18:22:34.528564 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: dbd7e50444cc4ef0873bfac9d9a2d514 Aug 09 18:22:34.528564 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-460293175 Aug 09 18:22:34.528564 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-ServerRescueNegativeTestJSON-460293175-project Aug 09 18:22:34.528564 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:22:34.528564 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:22:34.528564 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: 18fae6990e4148ff97dec28b204c52df Aug 09 18:22:34.528564 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-ServerRescueNegativeTestJSON-460293175-project Aug 09 18:22:34.528564 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:22:34.528564 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Cannot 'detach_volume' instance 245f64c6-0159-4c0d-816e-8cd5213fd655 while it is in vm_state rescued Aug 09 18:22:34.529268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'server_id': '245f64c6-0159-4c0d-816e-8cd5213fd655', 'id': '592eb6ec-81ff-43f0-8498-244b5aaa5422'} Aug 09 18:22:34.529268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:22:34.529268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:22:34.529268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 09 18:22:34.529268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 09 18:22:34.529268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 18:22:34.529268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 18:22:34.529268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 18:22:34.529268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 18:22:34.529268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 245f64c6-0159-4c0d-816e-8cd5213fd655 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 09 18:22:34.529268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:22:34.529268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:22:34.529268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:22:34.529268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:22:34.529268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:22:34.529268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:22:34.529268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:22:34.529268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:22:34.529268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:22:34.529268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:22:34.530522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 09 18:22:34.530522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 18:22:34.530522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 18:22:34.530522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 18:22:34.530522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 245f64c6-0159-4c0d-816e-8cd5213fd655 while it is in vm_state rescued Aug 09 18:22:34.530522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:22:34.530522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:22:34.530522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:22:34.530522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:22:34.530522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:22:34.530522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:22:34.530522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:22:34.530522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:22:34.530522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 245f64c6-0159-4c0d-816e-8cd5213fd655 while it is in vm_state rescued Aug 09 18:22:34.530522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:22:34.530522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9c32552a-2e98-4635-b267-901329da21bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Returning 409 to user: Cannot 'detach_volume' instance 245f64c6-0159-4c0d-816e-8cd5213fd655 while it is in vm_state rescued {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:22:34.531543 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9c32552a-2e98-4635-b267-901329da21bd tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "DELETE /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655/os-volume_attachments/592eb6ec-81ff-43f0-8498-244b5aaa5422" status: 409 len: 152 microversion: 2.1 time: 0.100932 Aug 09 18:22:34.531543 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 327/631] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Aug 9 18:22:34 2022] DELETE /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655/os-volume_attachments/592eb6ec-81ff-43f0-8498-244b5aaa5422 => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 18:22:34.531817 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-7446ea48-f716-4258-8bcd-f4b2140c896d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:22:34.532349 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-7446ea48-f716-4258-8bcd-f4b2140c896d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:34.538364 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7446ea48-f716-4258-8bcd-f4b2140c896d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:34.538894 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7446ea48-f716-4258-8bcd-f4b2140c896d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:34.539329 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7446ea48-f716-4258-8bcd-f4b2140c896d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:34.540055 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7446ea48-f716-4258-8bcd-f4b2140c896d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:34.540582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7446ea48-f716-4258-8bcd-f4b2140c896d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:34.540949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7446ea48-f716-4258-8bcd-f4b2140c896d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:34.583554 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-868cb2f6-b643-4932-b459-bd641e07ad8f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:34.584170 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-868cb2f6-b643-4932-b459-bd641e07ad8f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:34.591425 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-868cb2f6-b643-4932-b459-bd641e07ad8f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:34.591919 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-868cb2f6-b643-4932-b459-bd641e07ad8f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:34.592363 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-868cb2f6-b643-4932-b459-bd641e07ad8f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:34.593062 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-868cb2f6-b643-4932-b459-bd641e07ad8f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:34.593524 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-868cb2f6-b643-4932-b459-bd641e07ad8f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:34.593951 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-868cb2f6-b643-4932-b459-bd641e07ad8f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:34.655881 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-868cb2f6-b643-4932-b459-bd641e07ad8f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:34.663243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-868cb2f6-b643-4932-b459-bd641e07ad8f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1263 microversion: 2.1 time: 0.083507 Aug 09 18:22:34.663804 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 328/632] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:34 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1263 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:22:34.757340 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-7446ea48-f716-4258-8bcd-f4b2140c896d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "POST /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655/action" status: 202 len: 0 microversion: 2.1 time: 0.229357 Aug 09 18:22:34.757982 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 305/633] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Aug 9 18:22:34 2022] POST /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:22:34.766786 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-ec451f16-a93f-4706-973d-78acf4c86323 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:34.769388 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-ec451f16-a93f-4706-973d-78acf4c86323 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:34.774423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ec451f16-a93f-4706-973d-78acf4c86323 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:34.774983 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ec451f16-a93f-4706-973d-78acf4c86323 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:34.777285 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ec451f16-a93f-4706-973d-78acf4c86323 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:34.778449 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ec451f16-a93f-4706-973d-78acf4c86323 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:34.779136 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ec451f16-a93f-4706-973d-78acf4c86323 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:34.779583 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ec451f16-a93f-4706-973d-78acf4c86323 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:34.920449 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ec451f16-a93f-4706-973d-78acf4c86323 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:34.928772 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-ec451f16-a93f-4706-973d-78acf4c86323 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1723 microversion: 2.1 time: 0.165883 Aug 09 18:22:34.929348 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 329/634] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:34 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:35.687214 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d723dffb-a3a7-4ec0-80b3-d6a0da8046f4 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:35.687921 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d723dffb-a3a7-4ec0-80b3-d6a0da8046f4 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:35.694330 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d723dffb-a3a7-4ec0-80b3-d6a0da8046f4 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:35.694851 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d723dffb-a3a7-4ec0-80b3-d6a0da8046f4 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:35.698411 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d723dffb-a3a7-4ec0-80b3-d6a0da8046f4 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:35.698411 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d723dffb-a3a7-4ec0-80b3-d6a0da8046f4 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:35.698411 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d723dffb-a3a7-4ec0-80b3-d6a0da8046f4 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:35.698411 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d723dffb-a3a7-4ec0-80b3-d6a0da8046f4 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:35.701047 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:22:35.780365 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d723dffb-a3a7-4ec0-80b3-d6a0da8046f4 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:35.790508 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d723dffb-a3a7-4ec0-80b3-d6a0da8046f4 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1311 microversion: 2.1 time: 0.109731 Aug 09 18:22:35.803295 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 306/635] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:35 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1311 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:35.950966 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d70c5fca-c01d-4f46-8ac4-6e9870e57575 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:35.951687 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d70c5fca-c01d-4f46-8ac4-6e9870e57575 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:35.957999 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d70c5fca-c01d-4f46-8ac4-6e9870e57575 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:35.958573 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d70c5fca-c01d-4f46-8ac4-6e9870e57575 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:35.959099 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d70c5fca-c01d-4f46-8ac4-6e9870e57575 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:35.959863 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d70c5fca-c01d-4f46-8ac4-6e9870e57575 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:35.960384 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d70c5fca-c01d-4f46-8ac4-6e9870e57575 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:35.960811 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d70c5fca-c01d-4f46-8ac4-6e9870e57575 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:36.129912 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d70c5fca-c01d-4f46-8ac4-6e9870e57575 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:36.138330 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d70c5fca-c01d-4f46-8ac4-6e9870e57575 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1723 microversion: 2.1 time: 0.192480 Aug 09 18:22:36.139282 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 330/636] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:35 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:36.813470 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-241cc5be-150f-47e1-a76c-b83e4891e8c2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:36.814101 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-241cc5be-150f-47e1-a76c-b83e4891e8c2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:36.821069 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-241cc5be-150f-47e1-a76c-b83e4891e8c2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:36.821556 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-241cc5be-150f-47e1-a76c-b83e4891e8c2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:36.822873 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-241cc5be-150f-47e1-a76c-b83e4891e8c2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:36.825788 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-241cc5be-150f-47e1-a76c-b83e4891e8c2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:36.825788 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-241cc5be-150f-47e1-a76c-b83e4891e8c2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:36.825788 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-241cc5be-150f-47e1-a76c-b83e4891e8c2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:36.888628 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-241cc5be-150f-47e1-a76c-b83e4891e8c2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:36.896063 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-241cc5be-150f-47e1-a76c-b83e4891e8c2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1317 microversion: 2.1 time: 0.086803 Aug 09 18:22:36.896619 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 307/637] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:36 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1317 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:37.159619 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a8393b77-ccd0-40de-9c9d-20e31baaedc2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:37.160158 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a8393b77-ccd0-40de-9c9d-20e31baaedc2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:37.166987 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a8393b77-ccd0-40de-9c9d-20e31baaedc2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:37.167464 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a8393b77-ccd0-40de-9c9d-20e31baaedc2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:37.167920 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a8393b77-ccd0-40de-9c9d-20e31baaedc2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:37.168601 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a8393b77-ccd0-40de-9c9d-20e31baaedc2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:37.169052 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a8393b77-ccd0-40de-9c9d-20e31baaedc2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:37.169467 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a8393b77-ccd0-40de-9c9d-20e31baaedc2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:37.299874 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a8393b77-ccd0-40de-9c9d-20e31baaedc2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:37.308497 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a8393b77-ccd0-40de-9c9d-20e31baaedc2 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1723 microversion: 2.1 time: 0.152721 Aug 09 18:22:37.309060 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 331/638] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:37 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:37.918370 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-86044d6d-ff48-40ae-8c94-3aeb9175d2bf tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:37.919053 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-86044d6d-ff48-40ae-8c94-3aeb9175d2bf tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:37.925382 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-86044d6d-ff48-40ae-8c94-3aeb9175d2bf tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:37.925856 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-86044d6d-ff48-40ae-8c94-3aeb9175d2bf tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:37.926290 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-86044d6d-ff48-40ae-8c94-3aeb9175d2bf tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:37.927451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-86044d6d-ff48-40ae-8c94-3aeb9175d2bf tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:37.927451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-86044d6d-ff48-40ae-8c94-3aeb9175d2bf tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:37.927880 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-86044d6d-ff48-40ae-8c94-3aeb9175d2bf tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:38.000586 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-86044d6d-ff48-40ae-8c94-3aeb9175d2bf tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:38.008514 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-86044d6d-ff48-40ae-8c94-3aeb9175d2bf tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1317 microversion: 2.1 time: 0.095223 Aug 09 18:22:38.009166 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 308/639] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:37 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1317 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:38.329279 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f5988b46-399a-45a5-823c-ee5eda6f14e4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:38.329893 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f5988b46-399a-45a5-823c-ee5eda6f14e4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:38.338583 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f5988b46-399a-45a5-823c-ee5eda6f14e4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:38.339113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f5988b46-399a-45a5-823c-ee5eda6f14e4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:38.339559 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f5988b46-399a-45a5-823c-ee5eda6f14e4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:38.340268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f5988b46-399a-45a5-823c-ee5eda6f14e4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:38.340726 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f5988b46-399a-45a5-823c-ee5eda6f14e4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:38.341178 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f5988b46-399a-45a5-823c-ee5eda6f14e4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:38.502906 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f5988b46-399a-45a5-823c-ee5eda6f14e4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:38.513354 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f5988b46-399a-45a5-823c-ee5eda6f14e4 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1723 microversion: 2.1 time: 0.187793 Aug 09 18:22:38.523056 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 332/640] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:38 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:39.030138 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-91db477c-b9cc-4cd0-8aca-6ff02fd75ec6 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:39.030790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-91db477c-b9cc-4cd0-8aca-6ff02fd75ec6 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:39.033063 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:22:39.037746 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-91db477c-b9cc-4cd0-8aca-6ff02fd75ec6 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:39.038234 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-91db477c-b9cc-4cd0-8aca-6ff02fd75ec6 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:39.038671 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-91db477c-b9cc-4cd0-8aca-6ff02fd75ec6 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:39.039405 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-91db477c-b9cc-4cd0-8aca-6ff02fd75ec6 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:39.039880 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-91db477c-b9cc-4cd0-8aca-6ff02fd75ec6 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:39.040294 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-91db477c-b9cc-4cd0-8aca-6ff02fd75ec6 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:39.176658 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-91db477c-b9cc-4cd0-8aca-6ff02fd75ec6 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:39.185035 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-91db477c-b9cc-4cd0-8aca-6ff02fd75ec6 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1359 microversion: 2.1 time: 0.158716 Aug 09 18:22:39.185599 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 309/641] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:39 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:39.535659 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9251a4b8-f0c1-419f-b171-2a99f163bb3b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:39.536410 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9251a4b8-f0c1-419f-b171-2a99f163bb3b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:39.543038 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9251a4b8-f0c1-419f-b171-2a99f163bb3b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:39.543538 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9251a4b8-f0c1-419f-b171-2a99f163bb3b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:39.544029 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9251a4b8-f0c1-419f-b171-2a99f163bb3b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:39.544814 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9251a4b8-f0c1-419f-b171-2a99f163bb3b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:39.545320 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9251a4b8-f0c1-419f-b171-2a99f163bb3b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:39.545749 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9251a4b8-f0c1-419f-b171-2a99f163bb3b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:39.677906 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9251a4b8-f0c1-419f-b171-2a99f163bb3b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:39.686648 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9251a4b8-f0c1-419f-b171-2a99f163bb3b tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1729 microversion: 2.1 time: 0.154948 Aug 09 18:22:39.687242 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 333/642] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:39 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:39.708697 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c5b8cd3a-f96c-438b-bd58-0d58b03922b1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:39.709190 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c5b8cd3a-f96c-438b-bd58-0d58b03922b1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:39.715415 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5b8cd3a-f96c-438b-bd58-0d58b03922b1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:39.715978 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5b8cd3a-f96c-438b-bd58-0d58b03922b1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:39.716498 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5b8cd3a-f96c-438b-bd58-0d58b03922b1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:39.717140 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5b8cd3a-f96c-438b-bd58-0d58b03922b1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:39.717589 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5b8cd3a-f96c-438b-bd58-0d58b03922b1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:39.718010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5b8cd3a-f96c-438b-bd58-0d58b03922b1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:39.797605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c5b8cd3a-f96c-438b-bd58-0d58b03922b1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092912 Aug 09 18:22:39.798201 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 310/643] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Aug 9 18:22:39 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:22:40.205250 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5bc50959-9c40-4616-926f-12de1771a73c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:40.205861 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-5bc50959-9c40-4616-926f-12de1771a73c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:40.211904 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5bc50959-9c40-4616-926f-12de1771a73c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:40.213469 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5bc50959-9c40-4616-926f-12de1771a73c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:40.214128 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5bc50959-9c40-4616-926f-12de1771a73c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:40.214878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5bc50959-9c40-4616-926f-12de1771a73c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:40.215344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5bc50959-9c40-4616-926f-12de1771a73c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:40.215769 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5bc50959-9c40-4616-926f-12de1771a73c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:40.431532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-5bc50959-9c40-4616-926f-12de1771a73c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:40.439209 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-5bc50959-9c40-4616-926f-12de1771a73c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1359 microversion: 2.1 time: 0.237500 Aug 09 18:22:40.440009 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 334/644] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:40 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:41.073305 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-2a2e797f-1021-43ae-a7c7-5c64420d0af3 req-9a555d27-1b7b-442e-ac4a-74240c3b6376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "245f64c6-0159-4c0d-816e-8cd5213fd655", "tag": "35a445c4-7451-48bc-a24d-97a7becfc3de"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:22:41.083780 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-2a2e797f-1021-43ae-a7c7-5c64420d0af3 req-9a555d27-1b7b-442e-ac4a-74240c3b6376 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:41.084643 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-2a2e797f-1021-43ae-a7c7-5c64420d0af3 req-9a555d27-1b7b-442e-ac4a-74240c3b6376 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:41.085297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-2a2e797f-1021-43ae-a7c7-5c64420d0af3 req-9a555d27-1b7b-442e-ac4a-74240c3b6376 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:41.101599 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-2a2e797f-1021-43ae-a7c7-5c64420d0af3 req-9a555d27-1b7b-442e-ac4a-74240c3b6376 service nova] Creating event network-changed:35a445c4-7451-48bc-a24d-97a7becfc3de for instance 245f64c6-0159-4c0d-816e-8cd5213fd655 on hv-cinder-79797 Aug 09 18:22:41.107385 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-2a2e797f-1021-43ae-a7c7-5c64420d0af3 req-9a555d27-1b7b-442e-ac4a-74240c3b6376 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038342 Aug 09 18:22:41.108582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 311/645] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:22:41.461645 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-0af5d9cd-942f-4a2e-9b29-ccbced59079e tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:41.463519 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-0af5d9cd-942f-4a2e-9b29-ccbced59079e tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:41.476653 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0af5d9cd-942f-4a2e-9b29-ccbced59079e tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:41.477153 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0af5d9cd-942f-4a2e-9b29-ccbced59079e tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:41.477585 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0af5d9cd-942f-4a2e-9b29-ccbced59079e tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:41.479828 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0af5d9cd-942f-4a2e-9b29-ccbced59079e tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:41.480298 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0af5d9cd-942f-4a2e-9b29-ccbced59079e tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:41.480741 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0af5d9cd-942f-4a2e-9b29-ccbced59079e tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:41.640695 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-0af5d9cd-942f-4a2e-9b29-ccbced59079e tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:41.648490 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-0af5d9cd-942f-4a2e-9b29-ccbced59079e tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1359 microversion: 2.1 time: 0.190769 Aug 09 18:22:41.649071 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 335/646] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:41 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:42.672621 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-bea52ed8-7d4c-4a02-becf-b9d669a4abb2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:42.673333 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-bea52ed8-7d4c-4a02-becf-b9d669a4abb2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:42.679592 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bea52ed8-7d4c-4a02-becf-b9d669a4abb2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:42.680226 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bea52ed8-7d4c-4a02-becf-b9d669a4abb2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:42.680830 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bea52ed8-7d4c-4a02-becf-b9d669a4abb2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:42.681969 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bea52ed8-7d4c-4a02-becf-b9d669a4abb2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:42.682524 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bea52ed8-7d4c-4a02-becf-b9d669a4abb2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:42.682978 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bea52ed8-7d4c-4a02-becf-b9d669a4abb2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:42.822804 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-bea52ed8-7d4c-4a02-becf-b9d669a4abb2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:42.830667 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-bea52ed8-7d4c-4a02-becf-b9d669a4abb2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1359 microversion: 2.1 time: 0.163607 Aug 09 18:22:42.831260 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 312/647] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:42 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:43.134407 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-d9ed749d-2d1b-42b8-a180-a09b7370c6e3 req-a6364eae-3ae6-4acb-b881-d1279235de01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "245f64c6-0159-4c0d-816e-8cd5213fd655", "tag": "35a445c4-7451-48bc-a24d-97a7becfc3de"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:22:43.144587 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-d9ed749d-2d1b-42b8-a180-a09b7370c6e3 req-a6364eae-3ae6-4acb-b881-d1279235de01 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:43.145067 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-d9ed749d-2d1b-42b8-a180-a09b7370c6e3 req-a6364eae-3ae6-4acb-b881-d1279235de01 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:43.145493 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-d9ed749d-2d1b-42b8-a180-a09b7370c6e3 req-a6364eae-3ae6-4acb-b881-d1279235de01 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:43.156970 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-d9ed749d-2d1b-42b8-a180-a09b7370c6e3 req-a6364eae-3ae6-4acb-b881-d1279235de01 service nova] Creating event network-changed:35a445c4-7451-48bc-a24d-97a7becfc3de for instance 245f64c6-0159-4c0d-816e-8cd5213fd655 on hv-cinder-79797 Aug 09 18:22:43.162094 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-d9ed749d-2d1b-42b8-a180-a09b7370c6e3 req-a6364eae-3ae6-4acb-b881-d1279235de01 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031457 Aug 09 18:22:43.162692 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 336/648] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:22:43.852940 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-7216b082-ff71-43d1-b6ca-89773a9304f1 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:43.853586 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-7216b082-ff71-43d1-b6ca-89773a9304f1 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:43.855567 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=2 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:22:43.856261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=6 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:22:43.862132 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7216b082-ff71-43d1-b6ca-89773a9304f1 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:43.862799 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7216b082-ff71-43d1-b6ca-89773a9304f1 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:43.868292 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7216b082-ff71-43d1-b6ca-89773a9304f1 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:43.868292 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7216b082-ff71-43d1-b6ca-89773a9304f1 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:43.868292 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7216b082-ff71-43d1-b6ca-89773a9304f1 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:43.868292 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7216b082-ff71-43d1-b6ca-89773a9304f1 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:44.008790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-7216b082-ff71-43d1-b6ca-89773a9304f1 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:44.017029 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-7216b082-ff71-43d1-b6ca-89773a9304f1 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1359 microversion: 2.1 time: 0.167832 Aug 09 18:22:44.017611 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 313/649] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:43 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:45.036187 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=6 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:22:45.041791 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-dc4ea67a-8b39-42ec-8771-30e3283a790f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:45.042515 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-dc4ea67a-8b39-42ec-8771-30e3283a790f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:45.048890 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dc4ea67a-8b39-42ec-8771-30e3283a790f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:45.052880 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dc4ea67a-8b39-42ec-8771-30e3283a790f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:45.052880 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dc4ea67a-8b39-42ec-8771-30e3283a790f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:45.052880 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dc4ea67a-8b39-42ec-8771-30e3283a790f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:45.052880 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dc4ea67a-8b39-42ec-8771-30e3283a790f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:45.053250 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dc4ea67a-8b39-42ec-8771-30e3283a790f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:45.191877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-dc4ea67a-8b39-42ec-8771-30e3283a790f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:45.204079 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-dc4ea67a-8b39-42ec-8771-30e3283a790f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1359 microversion: 2.1 time: 0.168951 Aug 09 18:22:45.204872 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 337/650] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:45 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:46.224974 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c30f7724-61c2-407f-83f4-7194eefbd71f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:46.225764 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c30f7724-61c2-407f-83f4-7194eefbd71f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:46.233008 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c30f7724-61c2-407f-83f4-7194eefbd71f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:46.233488 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c30f7724-61c2-407f-83f4-7194eefbd71f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:46.233919 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c30f7724-61c2-407f-83f4-7194eefbd71f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:46.234604 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c30f7724-61c2-407f-83f4-7194eefbd71f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:46.235076 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c30f7724-61c2-407f-83f4-7194eefbd71f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:46.235750 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c30f7724-61c2-407f-83f4-7194eefbd71f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:46.387108 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c30f7724-61c2-407f-83f4-7194eefbd71f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:46.394638 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c30f7724-61c2-407f-83f4-7194eefbd71f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1359 microversion: 2.1 time: 0.174167 Aug 09 18:22:46.395460 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 314/651] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:46 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:46.551004 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-49be4ad7-58ac-4aa7-b59b-6bafb59309d7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:46.564919 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-49be4ad7-58ac-4aa7-b59b-6bafb59309d7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:46.564919 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-49be4ad7-58ac-4aa7-b59b-6bafb59309d7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:46.564919 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-49be4ad7-58ac-4aa7-b59b-6bafb59309d7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:46.564919 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-49be4ad7-58ac-4aa7-b59b-6bafb59309d7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:46.565310 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-49be4ad7-58ac-4aa7-b59b-6bafb59309d7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:46.565310 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-49be4ad7-58ac-4aa7-b59b-6bafb59309d7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:46.565310 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-49be4ad7-58ac-4aa7-b59b-6bafb59309d7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:46.576173 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=100 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:22:46.593548 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-49be4ad7-58ac-4aa7-b59b-6bafb59309d7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/os-volume_attachments/c8cb1f92-cbd3-453d-9bcd-b2824ece0658" status: 200 len: 194 microversion: 2.20 time: 0.048448 Aug 09 18:22:46.599594 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 338/652] 10.222.0.36 () {60 vars in 1454 bytes} [Tue Aug 9 18:22:46 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/os-volume_attachments/c8cb1f92-cbd3-453d-9bcd-b2824ece0658 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:22:46.666160 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-b7e1182c-16df-47ba-a645-5c3f7939135b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:46.666656 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-b7e1182c-16df-47ba-a645-5c3f7939135b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:46.672849 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b7e1182c-16df-47ba-a645-5c3f7939135b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:46.673340 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b7e1182c-16df-47ba-a645-5c3f7939135b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:46.673778 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b7e1182c-16df-47ba-a645-5c3f7939135b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:46.674529 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b7e1182c-16df-47ba-a645-5c3f7939135b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:46.675015 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b7e1182c-16df-47ba-a645-5c3f7939135b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:46.675444 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b7e1182c-16df-47ba-a645-5c3f7939135b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:46.764888 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.objects.instance [None req-b7e1182c-16df-47ba-a645-5c3f7939135b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lazy-loading 'services' on Instance uuid 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 {{(pid=118314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:22:46.990541 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-b7e1182c-16df-47ba-a645-5c3f7939135b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/os-volume_attachments/c8cb1f92-cbd3-453d-9bcd-b2824ece0658" status: 202 len: 0 microversion: 2.20 time: 0.328333 Aug 09 18:22:46.993838 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 315/653] 10.222.0.36 () {60 vars in 1457 bytes} [Tue Aug 9 18:22:46 2022] DELETE /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/os-volume_attachments/c8cb1f92-cbd3-453d-9bcd-b2824ece0658 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:22:47.000122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-02d3d846-248a-42db-ad8e-eb977f4c7cac tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:47.002387 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-02d3d846-248a-42db-ad8e-eb977f4c7cac tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:47.008659 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-02d3d846-248a-42db-ad8e-eb977f4c7cac tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:47.009796 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-02d3d846-248a-42db-ad8e-eb977f4c7cac tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:47.010496 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-02d3d846-248a-42db-ad8e-eb977f4c7cac tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:47.011304 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-02d3d846-248a-42db-ad8e-eb977f4c7cac tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:47.011758 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-02d3d846-248a-42db-ad8e-eb977f4c7cac tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:47.012182 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-02d3d846-248a-42db-ad8e-eb977f4c7cac tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:47.043716 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-02d3d846-248a-42db-ad8e-eb977f4c7cac tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047745 Aug 09 18:22:47.044285 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 339/654] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Aug 9 18:22:46 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:22:47.417718 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d3904f9e-71f6-4af6-b350-2af6ef164526 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:47.418420 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d3904f9e-71f6-4af6-b350-2af6ef164526 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:47.424812 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d3904f9e-71f6-4af6-b350-2af6ef164526 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:47.425294 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d3904f9e-71f6-4af6-b350-2af6ef164526 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:47.425723 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d3904f9e-71f6-4af6-b350-2af6ef164526 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:47.426414 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d3904f9e-71f6-4af6-b350-2af6ef164526 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:47.426894 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d3904f9e-71f6-4af6-b350-2af6ef164526 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:47.427313 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d3904f9e-71f6-4af6-b350-2af6ef164526 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:47.569585 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d3904f9e-71f6-4af6-b350-2af6ef164526 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:47.578052 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d3904f9e-71f6-4af6-b350-2af6ef164526 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1359 microversion: 2.1 time: 0.165956 Aug 09 18:22:47.591500 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 316/655] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:47 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:48.056837 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a279d45d-4b50-4d93-812f-ac1f63c60b10 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:48.059004 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a279d45d-4b50-4d93-812f-ac1f63c60b10 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:48.067785 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a279d45d-4b50-4d93-812f-ac1f63c60b10 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:48.068396 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a279d45d-4b50-4d93-812f-ac1f63c60b10 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:48.068834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a279d45d-4b50-4d93-812f-ac1f63c60b10 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:48.069564 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a279d45d-4b50-4d93-812f-ac1f63c60b10 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:48.070017 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a279d45d-4b50-4d93-812f-ac1f63c60b10 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:48.070439 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a279d45d-4b50-4d93-812f-ac1f63c60b10 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:48.101125 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a279d45d-4b50-4d93-812f-ac1f63c60b10 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048676 Aug 09 18:22:48.101677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 340/656] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Aug 9 18:22:48 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:22:48.601422 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-985199aa-a0f6-4ba2-8fba-cb0aa572756d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:48.602044 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-985199aa-a0f6-4ba2-8fba-cb0aa572756d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:48.609662 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-985199aa-a0f6-4ba2-8fba-cb0aa572756d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:48.610154 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-985199aa-a0f6-4ba2-8fba-cb0aa572756d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:48.610876 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-985199aa-a0f6-4ba2-8fba-cb0aa572756d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:48.611577 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-985199aa-a0f6-4ba2-8fba-cb0aa572756d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:48.612031 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-985199aa-a0f6-4ba2-8fba-cb0aa572756d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:48.612456 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-985199aa-a0f6-4ba2-8fba-cb0aa572756d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:48.760965 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-985199aa-a0f6-4ba2-8fba-cb0aa572756d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:48.769216 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-985199aa-a0f6-4ba2-8fba-cb0aa572756d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1359 microversion: 2.1 time: 0.171569 Aug 09 18:22:48.769979 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 317/657] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:48 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:49.115314 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-7cf9f4bb-18b8-41d0-9911-872fb60fd8bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:49.117479 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-7cf9f4bb-18b8-41d0-9911-872fb60fd8bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:49.124613 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7cf9f4bb-18b8-41d0-9911-872fb60fd8bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:49.125100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7cf9f4bb-18b8-41d0-9911-872fb60fd8bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:49.125540 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7cf9f4bb-18b8-41d0-9911-872fb60fd8bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:49.126235 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7cf9f4bb-18b8-41d0-9911-872fb60fd8bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:49.126692 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7cf9f4bb-18b8-41d0-9911-872fb60fd8bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:49.127145 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7cf9f4bb-18b8-41d0-9911-872fb60fd8bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:49.155665 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-7cf9f4bb-18b8-41d0-9911-872fb60fd8bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044284 Aug 09 18:22:49.156216 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 341/658] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Aug 9 18:22:49 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:22:49.792957 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-81459c7d-3664-453e-ac8f-e3ea6c2c7055 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:49.793563 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-81459c7d-3664-453e-ac8f-e3ea6c2c7055 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:49.799919 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-81459c7d-3664-453e-ac8f-e3ea6c2c7055 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:49.800390 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-81459c7d-3664-453e-ac8f-e3ea6c2c7055 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:49.800818 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-81459c7d-3664-453e-ac8f-e3ea6c2c7055 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:49.801490 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-81459c7d-3664-453e-ac8f-e3ea6c2c7055 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:49.801935 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-81459c7d-3664-453e-ac8f-e3ea6c2c7055 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:49.802352 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-81459c7d-3664-453e-ac8f-e3ea6c2c7055 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:49.929925 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-81459c7d-3664-453e-ac8f-e3ea6c2c7055 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:49.937384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-81459c7d-3664-453e-ac8f-e3ea6c2c7055 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1359 microversion: 2.1 time: 0.148319 Aug 09 18:22:49.937946 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 318/659] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:49 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:50.168105 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-7c21c9b7-4254-4868-a729-d85b93a544e3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:50.170141 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-7c21c9b7-4254-4868-a729-d85b93a544e3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:50.176423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7c21c9b7-4254-4868-a729-d85b93a544e3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:50.176901 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7c21c9b7-4254-4868-a729-d85b93a544e3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:50.177332 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7c21c9b7-4254-4868-a729-d85b93a544e3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:50.178014 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7c21c9b7-4254-4868-a729-d85b93a544e3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:50.178462 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7c21c9b7-4254-4868-a729-d85b93a544e3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:50.178923 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7c21c9b7-4254-4868-a729-d85b93a544e3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:50.209452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-7c21c9b7-4254-4868-a729-d85b93a544e3 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045458 Aug 09 18:22:50.210013 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 342/660] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Aug 9 18:22:50 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:22:50.958274 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-26aebb77-18ee-4f56-bfc5-1e4ba4ba6c55 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:50.958949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-26aebb77-18ee-4f56-bfc5-1e4ba4ba6c55 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:50.965808 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-26aebb77-18ee-4f56-bfc5-1e4ba4ba6c55 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:50.966291 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-26aebb77-18ee-4f56-bfc5-1e4ba4ba6c55 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:50.966743 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-26aebb77-18ee-4f56-bfc5-1e4ba4ba6c55 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:50.967439 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-26aebb77-18ee-4f56-bfc5-1e4ba4ba6c55 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:50.967889 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-26aebb77-18ee-4f56-bfc5-1e4ba4ba6c55 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:50.968308 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-26aebb77-18ee-4f56-bfc5-1e4ba4ba6c55 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:51.102453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-26aebb77-18ee-4f56-bfc5-1e4ba4ba6c55 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:51.110697 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-26aebb77-18ee-4f56-bfc5-1e4ba4ba6c55 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1359 microversion: 2.1 time: 0.155967 Aug 09 18:22:51.111285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 319/661] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:50 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:51.221489 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c6912cf1-8c22-44a6-8655-646c5a39f6a7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:51.223645 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-c6912cf1-8c22-44a6-8655-646c5a39f6a7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:51.225930 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:22:51.231314 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c6912cf1-8c22-44a6-8655-646c5a39f6a7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:51.231799 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c6912cf1-8c22-44a6-8655-646c5a39f6a7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:51.232239 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c6912cf1-8c22-44a6-8655-646c5a39f6a7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:51.232932 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c6912cf1-8c22-44a6-8655-646c5a39f6a7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:51.233387 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c6912cf1-8c22-44a6-8655-646c5a39f6a7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:51.233815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c6912cf1-8c22-44a6-8655-646c5a39f6a7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:51.263589 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-c6912cf1-8c22-44a6-8655-646c5a39f6a7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045995 Aug 09 18:22:51.264142 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 343/662] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Aug 9 18:22:51 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:22:52.131525 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-b4c9e8a1-b4b2-4fce-ac32-b509294c504d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:52.132067 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-b4c9e8a1-b4b2-4fce-ac32-b509294c504d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:52.138984 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b4c9e8a1-b4b2-4fce-ac32-b509294c504d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:52.139478 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b4c9e8a1-b4b2-4fce-ac32-b509294c504d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:52.139908 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b4c9e8a1-b4b2-4fce-ac32-b509294c504d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:52.140800 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b4c9e8a1-b4b2-4fce-ac32-b509294c504d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:52.141479 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b4c9e8a1-b4b2-4fce-ac32-b509294c504d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:52.141903 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b4c9e8a1-b4b2-4fce-ac32-b509294c504d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:52.277563 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f3c19b9f-f616-481c-93c6-c236780d5bf7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:52.280347 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-b4c9e8a1-b4b2-4fce-ac32-b509294c504d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:52.284167 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f3c19b9f-f616-481c-93c6-c236780d5bf7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:52.296216 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-b4c9e8a1-b4b2-4fce-ac32-b509294c504d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1359 microversion: 2.1 time: 0.168505 Aug 09 18:22:52.296808 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 320/663] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:52 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:52.298387 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f3c19b9f-f616-481c-93c6-c236780d5bf7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:52.298914 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f3c19b9f-f616-481c-93c6-c236780d5bf7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:52.299352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f3c19b9f-f616-481c-93c6-c236780d5bf7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:52.300150 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f3c19b9f-f616-481c-93c6-c236780d5bf7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:52.300525 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f3c19b9f-f616-481c-93c6-c236780d5bf7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:52.300943 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f3c19b9f-f616-481c-93c6-c236780d5bf7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:52.330656 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f3c19b9f-f616-481c-93c6-c236780d5bf7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058295 Aug 09 18:22:52.331304 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 344/664] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Aug 9 18:22:52 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:22:52.799789 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-791d9260-7359-4c04-ae76-b565b5a96f3c req-36d28bd0-5fff-4a76-bf82-66760594d33c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "641782b3-69ae-49c4-bc58-608cf91d08f8", "tag": "6517c4a8-4f1c-427c-b492-618a0970aaef"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:22:52.810340 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-791d9260-7359-4c04-ae76-b565b5a96f3c req-36d28bd0-5fff-4a76-bf82-66760594d33c service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:52.810872 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-791d9260-7359-4c04-ae76-b565b5a96f3c req-36d28bd0-5fff-4a76-bf82-66760594d33c service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:52.811442 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-791d9260-7359-4c04-ae76-b565b5a96f3c req-36d28bd0-5fff-4a76-bf82-66760594d33c service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:52.823947 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-791d9260-7359-4c04-ae76-b565b5a96f3c req-36d28bd0-5fff-4a76-bf82-66760594d33c service nova] Creating event network-changed:6517c4a8-4f1c-427c-b492-618a0970aaef for instance 641782b3-69ae-49c4-bc58-608cf91d08f8 on hv-cinder-79797 Aug 09 18:22:52.829274 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-791d9260-7359-4c04-ae76-b565b5a96f3c req-36d28bd0-5fff-4a76-bf82-66760594d33c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164068 Aug 09 18:22:52.829878 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 321/665] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:22:53.317606 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-4d9e3045-7f0d-4fd1-aa24-0946e787ebbd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:53.318319 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-4d9e3045-7f0d-4fd1-aa24-0946e787ebbd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:53.325582 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d9e3045-7f0d-4fd1-aa24-0946e787ebbd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:53.326068 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d9e3045-7f0d-4fd1-aa24-0946e787ebbd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:53.326524 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d9e3045-7f0d-4fd1-aa24-0946e787ebbd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:53.327237 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d9e3045-7f0d-4fd1-aa24-0946e787ebbd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:53.327689 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d9e3045-7f0d-4fd1-aa24-0946e787ebbd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:53.328216 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d9e3045-7f0d-4fd1-aa24-0946e787ebbd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:53.351518 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8670df84-3c25-459b-a52a-3aefdffd9d69 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:53.354580 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8670df84-3c25-459b-a52a-3aefdffd9d69 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:53.361759 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8670df84-3c25-459b-a52a-3aefdffd9d69 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:53.362384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8670df84-3c25-459b-a52a-3aefdffd9d69 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:53.363176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8670df84-3c25-459b-a52a-3aefdffd9d69 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:53.363974 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8670df84-3c25-459b-a52a-3aefdffd9d69 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:53.364656 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8670df84-3c25-459b-a52a-3aefdffd9d69 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:53.365284 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8670df84-3c25-459b-a52a-3aefdffd9d69 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:53.398525 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8670df84-3c25-459b-a52a-3aefdffd9d69 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053300 Aug 09 18:22:53.399137 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 322/666] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Aug 9 18:22:53 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:53.469221 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-225f8b9e-a2fa-4771-964f-86a6a2391616 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:53.469721 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-225f8b9e-a2fa-4771-964f-86a6a2391616 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:53.475598 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-225f8b9e-a2fa-4771-964f-86a6a2391616 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:53.476080 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-225f8b9e-a2fa-4771-964f-86a6a2391616 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:53.476514 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-225f8b9e-a2fa-4771-964f-86a6a2391616 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:53.477237 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-225f8b9e-a2fa-4771-964f-86a6a2391616 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:53.478337 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-225f8b9e-a2fa-4771-964f-86a6a2391616 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:53.478782 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-225f8b9e-a2fa-4771-964f-86a6a2391616 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:53.506771 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-225f8b9e-a2fa-4771-964f-86a6a2391616 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Going to try to terminate instance {{(pid=118314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:22:53.510357 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:22:53.514591 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4d9e3045-7f0d-4fd1-aa24-0946e787ebbd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:53.522577 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-4d9e3045-7f0d-4fd1-aa24-0946e787ebbd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1359 microversion: 2.1 time: 0.208985 Aug 09 18:22:53.523201 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 345/667] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:53 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:53.776831 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-225f8b9e-a2fa-4771-964f-86a6a2391616 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 204 len: 0 microversion: 2.20 time: 0.311075 Aug 09 18:22:53.777335 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 323/668] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Aug 9 18:22:53 2022] DELETE /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 09 18:22:53.785460 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-67711806-505d-4b45-baa8-48d914eb1ede tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:53.786101 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-67711806-505d-4b45-baa8-48d914eb1ede tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:53.792331 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-67711806-505d-4b45-baa8-48d914eb1ede tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:53.792808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-67711806-505d-4b45-baa8-48d914eb1ede tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:53.793241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-67711806-505d-4b45-baa8-48d914eb1ede tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:53.793918 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-67711806-505d-4b45-baa8-48d914eb1ede tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:53.794371 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-67711806-505d-4b45-baa8-48d914eb1ede tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:53.794815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-67711806-505d-4b45-baa8-48d914eb1ede tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:53.923804 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-67711806-505d-4b45-baa8-48d914eb1ede tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:53.932584 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-67711806-505d-4b45-baa8-48d914eb1ede tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:53.934088 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-67711806-505d-4b45-baa8-48d914eb1ede tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:53.935270 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-67711806-505d-4b45-baa8-48d914eb1ede tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.153605 Aug 09 18:22:53.935825 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 346/669] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:22:53 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:22:54.545040 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-66019744-9756-4472-97d7-a160c3c729f2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:54.545762 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-66019744-9756-4472-97d7-a160c3c729f2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:54.552375 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-66019744-9756-4472-97d7-a160c3c729f2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:54.552847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-66019744-9756-4472-97d7-a160c3c729f2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:54.553280 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-66019744-9756-4472-97d7-a160c3c729f2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:54.553983 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-66019744-9756-4472-97d7-a160c3c729f2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:54.554431 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-66019744-9756-4472-97d7-a160c3c729f2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:54.554870 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-66019744-9756-4472-97d7-a160c3c729f2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:54.710158 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-66019744-9756-4472-97d7-a160c3c729f2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:54.718119 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-66019744-9756-4472-97d7-a160c3c729f2 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1359 microversion: 2.1 time: 0.177960 Aug 09 18:22:54.718612 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 324/670] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:54 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:54.958825 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-1015947a-d655-4c7a-9652-90893e18ea31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:54.959436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-1015947a-d655-4c7a-9652-90893e18ea31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:54.966648 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1015947a-d655-4c7a-9652-90893e18ea31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:54.967162 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1015947a-d655-4c7a-9652-90893e18ea31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:54.967602 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1015947a-d655-4c7a-9652-90893e18ea31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:54.968327 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1015947a-d655-4c7a-9652-90893e18ea31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:54.968744 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1015947a-d655-4c7a-9652-90893e18ea31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:54.969156 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1015947a-d655-4c7a-9652-90893e18ea31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:55.097862 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-1015947a-d655-4c7a-9652-90893e18ea31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:55.105932 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-1015947a-d655-4c7a-9652-90893e18ea31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:55.107479 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-1015947a-d655-4c7a-9652-90893e18ea31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:55.108624 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-1015947a-d655-4c7a-9652-90893e18ea31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.153845 Aug 09 18:22:55.109183 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 347/671] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:22:54 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:22:55.739851 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-15b21897-bee5-4438-a32e-ad17ab913e16 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:55.740584 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-15b21897-bee5-4438-a32e-ad17ab913e16 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:55.748448 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15b21897-bee5-4438-a32e-ad17ab913e16 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:55.749324 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15b21897-bee5-4438-a32e-ad17ab913e16 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:55.750023 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15b21897-bee5-4438-a32e-ad17ab913e16 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:55.751167 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15b21897-bee5-4438-a32e-ad17ab913e16 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:55.751847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15b21897-bee5-4438-a32e-ad17ab913e16 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:55.752326 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15b21897-bee5-4438-a32e-ad17ab913e16 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:55.889767 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-15b21897-bee5-4438-a32e-ad17ab913e16 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:55.897155 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-15b21897-bee5-4438-a32e-ad17ab913e16 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1359 microversion: 2.1 time: 0.161202 Aug 09 18:22:55.897720 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 325/672] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:55 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:56.131587 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-89691875-086b-4351-b501-629d1263bf31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:56.132187 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-89691875-086b-4351-b501-629d1263bf31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:56.138572 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-89691875-086b-4351-b501-629d1263bf31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:56.139085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-89691875-086b-4351-b501-629d1263bf31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:56.139525 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-89691875-086b-4351-b501-629d1263bf31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:56.140208 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-89691875-086b-4351-b501-629d1263bf31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:56.140664 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-89691875-086b-4351-b501-629d1263bf31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:56.141087 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-89691875-086b-4351-b501-629d1263bf31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:56.271657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-89691875-086b-4351-b501-629d1263bf31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:56.280094 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-89691875-086b-4351-b501-629d1263bf31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:56.281619 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-89691875-086b-4351-b501-629d1263bf31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:56.282818 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-89691875-086b-4351-b501-629d1263bf31 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.155047 Aug 09 18:22:56.283375 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 348/673] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:22:56 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:22:56.917875 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-85504392-0a59-4a81-86e7-5beb7a9ea940 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:56.918508 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-85504392-0a59-4a81-86e7-5beb7a9ea940 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:56.925000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-85504392-0a59-4a81-86e7-5beb7a9ea940 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:56.925477 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-85504392-0a59-4a81-86e7-5beb7a9ea940 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:56.925909 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-85504392-0a59-4a81-86e7-5beb7a9ea940 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:56.926592 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-85504392-0a59-4a81-86e7-5beb7a9ea940 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:56.927067 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-85504392-0a59-4a81-86e7-5beb7a9ea940 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:56.927489 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-85504392-0a59-4a81-86e7-5beb7a9ea940 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:57.055194 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-85504392-0a59-4a81-86e7-5beb7a9ea940 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:57.063102 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-85504392-0a59-4a81-86e7-5beb7a9ea940 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1359 microversion: 2.1 time: 0.149299 Aug 09 18:22:57.063657 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 326/674] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:56 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:57.306191 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d1aaf2bd-7ab0-40cf-9775-5f1371a9e9be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:57.306852 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d1aaf2bd-7ab0-40cf-9775-5f1371a9e9be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:57.313405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d1aaf2bd-7ab0-40cf-9775-5f1371a9e9be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:57.313892 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d1aaf2bd-7ab0-40cf-9775-5f1371a9e9be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:57.314334 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d1aaf2bd-7ab0-40cf-9775-5f1371a9e9be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:57.315059 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d1aaf2bd-7ab0-40cf-9775-5f1371a9e9be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:57.315520 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d1aaf2bd-7ab0-40cf-9775-5f1371a9e9be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:57.315951 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d1aaf2bd-7ab0-40cf-9775-5f1371a9e9be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:57.517210 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d1aaf2bd-7ab0-40cf-9775-5f1371a9e9be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:57.527234 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d1aaf2bd-7ab0-40cf-9775-5f1371a9e9be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:57.528933 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d1aaf2bd-7ab0-40cf-9775-5f1371a9e9be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:57.530089 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d1aaf2bd-7ab0-40cf-9775-5f1371a9e9be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.227895 Aug 09 18:22:57.530651 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 349/675] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:22:57 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:22:58.083543 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e99c423f-abd9-44ff-9e84-d490c49515e7 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:58.084156 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e99c423f-abd9-44ff-9e84-d490c49515e7 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:58.091343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e99c423f-abd9-44ff-9e84-d490c49515e7 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:58.091827 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e99c423f-abd9-44ff-9e84-d490c49515e7 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:58.092265 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e99c423f-abd9-44ff-9e84-d490c49515e7 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:58.092954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e99c423f-abd9-44ff-9e84-d490c49515e7 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:58.093405 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e99c423f-abd9-44ff-9e84-d490c49515e7 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:58.093833 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e99c423f-abd9-44ff-9e84-d490c49515e7 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:58.229204 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e99c423f-abd9-44ff-9e84-d490c49515e7 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:58.237177 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e99c423f-abd9-44ff-9e84-d490c49515e7 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1359 microversion: 2.1 time: 0.157410 Aug 09 18:22:58.237912 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 327/676] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:58 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:58.552834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-bfbfd563-439d-4957-939a-88f1bae8fcce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:58.553439 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-bfbfd563-439d-4957-939a-88f1bae8fcce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:58.560679 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bfbfd563-439d-4957-939a-88f1bae8fcce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:58.561167 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bfbfd563-439d-4957-939a-88f1bae8fcce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:58.561602 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bfbfd563-439d-4957-939a-88f1bae8fcce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:58.562294 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bfbfd563-439d-4957-939a-88f1bae8fcce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:58.562778 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bfbfd563-439d-4957-939a-88f1bae8fcce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:58.563207 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bfbfd563-439d-4957-939a-88f1bae8fcce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:58.701297 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-bfbfd563-439d-4957-939a-88f1bae8fcce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:58.709429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-bfbfd563-439d-4957-939a-88f1bae8fcce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:58.711016 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-bfbfd563-439d-4957-939a-88f1bae8fcce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:58.712196 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-bfbfd563-439d-4957-939a-88f1bae8fcce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1725 microversion: 2.20 time: 0.163375 Aug 09 18:22:58.712764 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 350/677] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:22:58 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:22:59.109527 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-a89da741-a797-4cca-99dc-6c472a1a29e0 req-203d6769-4d95-4460-a2e6-0ab036d443b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97", "name": "network-vif-deleted", "tag": "be3a4bfe-af09-41a6-9567-0b2aabb83ff4"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:22:59.120684 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-a89da741-a797-4cca-99dc-6c472a1a29e0 req-203d6769-4d95-4460-a2e6-0ab036d443b4 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:59.121161 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-a89da741-a797-4cca-99dc-6c472a1a29e0 req-203d6769-4d95-4460-a2e6-0ab036d443b4 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:59.121587 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-a89da741-a797-4cca-99dc-6c472a1a29e0 req-203d6769-4d95-4460-a2e6-0ab036d443b4 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:59.133149 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-a89da741-a797-4cca-99dc-6c472a1a29e0 req-203d6769-4d95-4460-a2e6-0ab036d443b4 service nova] Creating event network-vif-deleted:be3a4bfe-af09-41a6-9567-0b2aabb83ff4 for instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 on hv-cinder-79797 Aug 09 18:22:59.139128 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-a89da741-a797-4cca-99dc-6c472a1a29e0 req-203d6769-4d95-4460-a2e6-0ab036d443b4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033395 Aug 09 18:22:59.140400 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 328/678] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:22:59.258551 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a49451e8-0335-47e9-90d5-f0ab717e93b3 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:59.263862 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a49451e8-0335-47e9-90d5-f0ab717e93b3 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:59.266050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a49451e8-0335-47e9-90d5-f0ab717e93b3 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:59.266550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a49451e8-0335-47e9-90d5-f0ab717e93b3 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:59.267036 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a49451e8-0335-47e9-90d5-f0ab717e93b3 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:59.268077 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a49451e8-0335-47e9-90d5-f0ab717e93b3 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:59.268496 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a49451e8-0335-47e9-90d5-f0ab717e93b3 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:59.268952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a49451e8-0335-47e9-90d5-f0ab717e93b3 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:59.410134 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a49451e8-0335-47e9-90d5-f0ab717e93b3 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:59.416694 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a49451e8-0335-47e9-90d5-f0ab717e93b3 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1359 microversion: 2.1 time: 0.162050 Aug 09 18:22:59.427169 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 351/679] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:59 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:22:59.737430 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-79486b18-7bb5-474a-9352-3c504bc8b726 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:59.738237 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-79486b18-7bb5-474a-9352-3c504bc8b726 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:59.746362 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79486b18-7bb5-474a-9352-3c504bc8b726 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:59.747192 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79486b18-7bb5-474a-9352-3c504bc8b726 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:59.747868 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79486b18-7bb5-474a-9352-3c504bc8b726 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:59.748636 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79486b18-7bb5-474a-9352-3c504bc8b726 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:59.749188 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79486b18-7bb5-474a-9352-3c504bc8b726 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:59.749679 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79486b18-7bb5-474a-9352-3c504bc8b726 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:59.783741 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79486b18-7bb5-474a-9352-3c504bc8b726 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:59.784370 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79486b18-7bb5-474a-9352-3c504bc8b726 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:59.784866 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79486b18-7bb5-474a-9352-3c504bc8b726 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:59.785386 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.objects.instance [None req-79486b18-7bb5-474a-9352-3c504bc8b726 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lazy-loading 'fault' on Instance uuid 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 {{(pid=118314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:22:59.835569 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-79486b18-7bb5-474a-9352-3c504bc8b726 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:59.846617 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-79486b18-7bb5-474a-9352-3c504bc8b726 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:59.848510 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-79486b18-7bb5-474a-9352-3c504bc8b726 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:59.850275 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-79486b18-7bb5-474a-9352-3c504bc8b726 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 200 len: 1372 microversion: 2.20 time: 0.117594 Aug 09 18:22:59.866999 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 329/680] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:22:59 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 1372 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:23:00.111634 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-76abbe6b-dce4-49ab-bfd1-ba2a355fc16b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:00.119766 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-76abbe6b-dce4-49ab-bfd1-ba2a355fc16b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:00.119766 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-76abbe6b-dce4-49ab-bfd1-ba2a355fc16b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:00.119766 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-76abbe6b-dce4-49ab-bfd1-ba2a355fc16b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:00.119766 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-76abbe6b-dce4-49ab-bfd1-ba2a355fc16b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:00.120455 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-76abbe6b-dce4-49ab-bfd1-ba2a355fc16b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:00.120910 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-76abbe6b-dce4-49ab-bfd1-ba2a355fc16b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:00.121443 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-76abbe6b-dce4-49ab-bfd1-ba2a355fc16b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:00.216132 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.objects.instance [None req-76abbe6b-dce4-49ab-bfd1-ba2a355fc16b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lazy-loading 'services' on Instance uuid e9924434-5f51-4c4e-8355-93e69db65d9e {{(pid=118313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:23:00.438161 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-51b021ff-257b-4c32-acf2-9bc70a38136a tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:00.438739 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-51b021ff-257b-4c32-acf2-9bc70a38136a tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:00.445643 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-51b021ff-257b-4c32-acf2-9bc70a38136a tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:00.446145 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-51b021ff-257b-4c32-acf2-9bc70a38136a tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:00.447341 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-51b021ff-257b-4c32-acf2-9bc70a38136a tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:00.448222 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-51b021ff-257b-4c32-acf2-9bc70a38136a tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:00.448685 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-51b021ff-257b-4c32-acf2-9bc70a38136a tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:00.449115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-51b021ff-257b-4c32-acf2-9bc70a38136a tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:00.465704 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-76abbe6b-dce4-49ab-bfd1-ba2a355fc16b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e/os-volume_attachments/949fb134-fb39-4f32-bb9e-2cd4ccb90c2f" status: 202 len: 0 microversion: 2.1 time: 0.488502 Aug 09 18:23:00.467158 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 352/681] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Aug 9 18:22:59 2022] DELETE /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e/os-volume_attachments/949fb134-fb39-4f32-bb9e-2cd4ccb90c2f => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:23:00.521317 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-38589a6a-ae1f-42b5-a509-a14f17a9f4de req-b578face-bcf1-45ba-9d19-e834c1355e93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "641782b3-69ae-49c4-bc58-608cf91d08f8", "name": "network-vif-plugged", "status": "completed", "tag": "6517c4a8-4f1c-427c-b492-618a0970aaef"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:23:00.537666 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-38589a6a-ae1f-42b5-a509-a14f17a9f4de req-b578face-bcf1-45ba-9d19-e834c1355e93 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:00.538154 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-38589a6a-ae1f-42b5-a509-a14f17a9f4de req-b578face-bcf1-45ba-9d19-e834c1355e93 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:00.538585 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-38589a6a-ae1f-42b5-a509-a14f17a9f4de req-b578face-bcf1-45ba-9d19-e834c1355e93 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:00.559379 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-38589a6a-ae1f-42b5-a509-a14f17a9f4de req-b578face-bcf1-45ba-9d19-e834c1355e93 service nova] Creating event network-vif-plugged:6517c4a8-4f1c-427c-b492-618a0970aaef for instance 641782b3-69ae-49c4-bc58-608cf91d08f8 on hv-cinder-79797 Aug 09 18:23:00.564801 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-38589a6a-ae1f-42b5-a509-a14f17a9f4de req-b578face-bcf1-45ba-9d19-e834c1355e93 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056153 Aug 09 18:23:00.565951 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 353/682] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:23:00.653430 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-51b021ff-257b-4c32-acf2-9bc70a38136a tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:00.672054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-51b021ff-257b-4c32-acf2-9bc70a38136a tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1359 microversion: 2.1 time: 0.238173 Aug 09 18:23:00.672685 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 330/683] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:00 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1359 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:23:00.874210 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2e71c18d-186b-4884-a4ca-c775f5127c41 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:00.874822 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-2e71c18d-186b-4884-a4ca-c775f5127c41 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:00.880830 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2e71c18d-186b-4884-a4ca-c775f5127c41 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:00.881308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2e71c18d-186b-4884-a4ca-c775f5127c41 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:00.881737 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2e71c18d-186b-4884-a4ca-c775f5127c41 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:00.882413 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2e71c18d-186b-4884-a4ca-c775f5127c41 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:00.882890 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2e71c18d-186b-4884-a4ca-c775f5127c41 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:00.883309 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2e71c18d-186b-4884-a4ca-c775f5127c41 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:00.896390 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-2e71c18d-186b-4884-a4ca-c775f5127c41 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] HTTP exception thrown: Instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 could not be found. Aug 09 18:23:00.897978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2e71c18d-186b-4884-a4ca-c775f5127c41 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Request method failure captured: Aug 09 18:23:00.897978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 HTTP/1.1 Aug 09 18:23:00.897978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:23:00.897978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:23:00.897978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:23:00.897978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:23:00.897978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:23:00.897978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:23:00.897978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:23:00.897978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:23:00.897978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qRH6oZvLYQzHHN5HiJQoKEuKN1gFCTx2nB6hBKLAZJDo6gRYlnHyk5KBDlF_RxYLpSZ8RIGNpVqT6M5QMjE12ok36SKMDQPp8Ay9fDGma13RsX7D6onn9MKNQ_v3NCaONsTOjUgfR_mpEXkOb0e1XxZoskKzZdOnHgLXtUDhf6O6JQ Aug 09 18:23:00.897978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:23:00.897978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:23:00.897978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:23:00.897978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:23:00.897978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 18:23:00.897978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:23:00.897978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:23:00.897978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: ac2e5c4bafff4b16bb9d82dacb5dd056 Aug 09 18:23:00.897978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-344752246 Aug 09 18:23:00.897978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:23:00.897978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:23:00.900176 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ac2e5c4bafff4b16bb9d82dacb5dd056"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ac2e5c4bafff4b16bb9d82dacb5dd056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ac2e5c4bafff4b16bb9d82dacb5dd056", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ac2e5c4bafff4b16bb9d82dacb5dd056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:23:00.900176 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-AttachVolumeShelveTestJSON-344752246 Aug 09 18:23:00.900176 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: ac2e5c4bafff4b16bb9d82dacb5dd056 Aug 09 18:23:00.900176 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-344752246 Aug 09 18:23:00.900176 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-AttachVolumeShelveTestJSON-344752246-project Aug 09 18:23:00.900176 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:23:00.900176 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:23:00.900176 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: 528811040ede40bdb40e3e6e666d283d Aug 09 18:23:00.900176 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-AttachVolumeShelveTestJSON-344752246-project Aug 09 18:23:00.900176 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:23:00.900176 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 could not be found. Aug 09 18:23:00.900176 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': '9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97'} Aug 09 18:23:00.901952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:23:00.901952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:23:00.901952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:23:00.901952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:23:00.901952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:23:00.901952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:23:00.901952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:23:00.901952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:23:00.901952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:23:00.901952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:23:00.901952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 could not be found. Aug 09 18:23:00.901952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:23:00.901952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:23:00.901952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:23:00.901952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:23:00.901952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:23:00.901952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:23:00.901952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:23:00.901952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:23:00.901952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:23:00.903427 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:23:00.903427 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:23:00.903427 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:23:00.903427 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:23:00.903427 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:23:00.903427 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:23:00.903427 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:23:00.903427 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 could not be found. Aug 09 18:23:00.903427 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:23:00.903427 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:23:00.903427 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:23:00.903427 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:23:00.903427 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:23:00.903427 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:23:00.903427 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:23:00.903427 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:23:00.903427 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 could not be found. Aug 09 18:23:00.903427 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:23:00.904669 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2e71c18d-186b-4884-a4ca-c775f5127c41 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Returning 404 to user: Instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:23:00.904669 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-2e71c18d-186b-4884-a4ca-c775f5127c41 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 404 len: 111 microversion: 2.20 time: 0.029466 Aug 09 18:23:00.904669 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 354/684] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:23:00 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:23:00.909033 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-3dada3ea-adf1-421e-948d-d743efff4df4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '.version_select at 0x7f4c35293a60>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:00.997093 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-3dada3ea-adf1-421e-948d-d743efff4df4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1826225726" status: 204 len: 0 microversion: 2.20 time: 0.091861 Aug 09 18:23:00.997733 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 331/685] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Aug 9 18:23:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1826225726 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 18:23:01.692783 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2f574cff-2e6c-40e7-be26-60fb64ab1f45 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:01.693538 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-2f574cff-2e6c-40e7-be26-60fb64ab1f45 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:01.701899 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2f574cff-2e6c-40e7-be26-60fb64ab1f45 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:01.702836 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2f574cff-2e6c-40e7-be26-60fb64ab1f45 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:01.703633 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2f574cff-2e6c-40e7-be26-60fb64ab1f45 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:01.704382 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2f574cff-2e6c-40e7-be26-60fb64ab1f45 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:01.704838 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2f574cff-2e6c-40e7-be26-60fb64ab1f45 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:01.705485 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2f574cff-2e6c-40e7-be26-60fb64ab1f45 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:01.826262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-acd0a85e-4982-46a9-ad44-1c52d8b7f429 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Action: 'create', calling method: .version_select at 0x7f4c352af4c0>, body: {"keypair": {"name": "tempest-keypair-383451288", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOo/XqTA9z86gfoyIzrsA5XFZpu5H35UG+QfiU8odJD+x9Bf4l3XiOGaeYvFeeDi4kuMb3IEHW9FmcAltN4nE/GKHzAzyzwBddte1e2wwFSEv1iD8m7xKEVDE+IuFsPINg=="}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:23:01.847200 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-2f574cff-2e6c-40e7-be26-60fb64ab1f45 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:01.849652 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:23:01.850167 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-acd0a85e-4982-46a9-ad44-1c52d8b7f429 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Getting quotas for project ac2e5c4bafff4b16bb9d82dacb5dd056. Resources: {'key_pairs'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:23:01.854891 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-acd0a85e-4982-46a9-ad44-1c52d8b7f429 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Getting quotas for user 528811040ede40bdb40e3e6e666d283d and project ac2e5c4bafff4b16bb9d82dacb5dd056. Resources: {'key_pairs'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:23:01.856343 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-2f574cff-2e6c-40e7-be26-60fb64ab1f45 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1359 microversion: 2.1 time: 0.167405 Aug 09 18:23:01.859190 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 355/686] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:01 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:01.957049 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-acd0a85e-4982-46a9-ad44-1c52d8b7f429 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.135272 Aug 09 18:23:01.957568 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 332/687] 10.222.0.36 () {62 vars in 1200 bytes} [Tue Aug 9 18:23:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 09 18:23:02.669723 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-226527ef-a87c-4081-bd25-a5a6ed9e1941 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:23:02.676386 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-226527ef-a87c-4081-bd25-a5a6ed9e1941 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:02.676898 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-226527ef-a87c-4081-bd25-a5a6ed9e1941 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:02.677374 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-226527ef-a87c-4081-bd25-a5a6ed9e1941 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:02.701900 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-226527ef-a87c-4081-bd25-a5a6ed9e1941 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Going to try to stop instance {{(pid=118313) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 18:23:02.878343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-6158b7e1-a69c-46ba-86b0-257f51f6f6dd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:02.878984 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-6158b7e1-a69c-46ba-86b0-257f51f6f6dd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:02.885524 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6158b7e1-a69c-46ba-86b0-257f51f6f6dd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:02.886007 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6158b7e1-a69c-46ba-86b0-257f51f6f6dd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:02.886451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6158b7e1-a69c-46ba-86b0-257f51f6f6dd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:02.887178 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6158b7e1-a69c-46ba-86b0-257f51f6f6dd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:02.887638 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6158b7e1-a69c-46ba-86b0-257f51f6f6dd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:02.888062 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6158b7e1-a69c-46ba-86b0-257f51f6f6dd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:02.894123 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-226527ef-a87c-4081-bd25-a5a6ed9e1941 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "POST /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e/action" status: 202 len: 0 microversion: 2.1 time: 0.228678 Aug 09 18:23:02.894730 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 356/688] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Aug 9 18:23:02 2022] POST /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:23:02.909133 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-0cd210f2-2c2b-440a-815e-3d3237c88a5c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:02.909837 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-0cd210f2-2c2b-440a-815e-3d3237c88a5c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:02.917227 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0cd210f2-2c2b-440a-815e-3d3237c88a5c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:02.917726 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0cd210f2-2c2b-440a-815e-3d3237c88a5c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:02.918162 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0cd210f2-2c2b-440a-815e-3d3237c88a5c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:02.918888 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0cd210f2-2c2b-440a-815e-3d3237c88a5c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:02.919346 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0cd210f2-2c2b-440a-815e-3d3237c88a5c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:02.919771 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0cd210f2-2c2b-440a-815e-3d3237c88a5c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:03.099578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-6158b7e1-a69c-46ba-86b0-257f51f6f6dd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:03.104369 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-0cd210f2-2c2b-440a-815e-3d3237c88a5c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:03.109204 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-6158b7e1-a69c-46ba-86b0-257f51f6f6dd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1550 microversion: 2.1 time: 0.234761 Aug 09 18:23:03.109838 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 333/689] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:02 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1550 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:23:03.113110 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-0cd210f2-2c2b-440a-815e-3d3237c88a5c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1678 microversion: 2.1 time: 0.213957 Aug 09 18:23:03.115363 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 357/690] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:02 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1678 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:23:03.134031 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-5335f19a-753b-475d-b924-32a0f28cf39c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:03.134771 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-5335f19a-753b-475d-b924-32a0f28cf39c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:03.141643 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5335f19a-753b-475d-b924-32a0f28cf39c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:03.146075 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5335f19a-753b-475d-b924-32a0f28cf39c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:03.146075 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5335f19a-753b-475d-b924-32a0f28cf39c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:03.146075 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5335f19a-753b-475d-b924-32a0f28cf39c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:03.146075 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5335f19a-753b-475d-b924-32a0f28cf39c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:03.146455 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5335f19a-753b-475d-b924-32a0f28cf39c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:03.284509 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-5335f19a-753b-475d-b924-32a0f28cf39c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:03.292480 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-5335f19a-753b-475d-b924-32a0f28cf39c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1550 microversion: 2.1 time: 0.162241 Aug 09 18:23:03.293049 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 334/691] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:03 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:03.312102 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6f2fac52-a552-457e-950b-7ac12187e089 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:03.316789 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6f2fac52-a552-457e-950b-7ac12187e089 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:03.317544 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-6f2fac52-a552-457e-950b-7ac12187e089 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Searching by: {'deleted': False, 'project_id': 'd793302181944f85ade371ded12ca4c4'} {{(pid=118313) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 18:23:03.324820 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6f2fac52-a552-457e-950b-7ac12187e089 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:03.325306 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6f2fac52-a552-457e-950b-7ac12187e089 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:03.325741 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6f2fac52-a552-457e-950b-7ac12187e089 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:03.326461 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6f2fac52-a552-457e-950b-7ac12187e089 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:03.326948 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6f2fac52-a552-457e-950b-7ac12187e089 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:03.327369 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6f2fac52-a552-457e-950b-7ac12187e089 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:03.418438 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.multi_cell_list [None req-6f2fac52-a552-457e-950b-7ac12187e089 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118313) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 18:23:03.516912 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-6f2fac52-a552-457e-950b-7ac12187e089 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.208342 Aug 09 18:23:03.517378 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 358/692] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Aug 9 18:23:03 2022] GET /compute/v2.1/servers => generated 343 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:23:03.528868 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-1f2cd945-4db3-4f52-9383-edf42e1fd9c0 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:03.529478 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-1f2cd945-4db3-4f52-9383-edf42e1fd9c0 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:03.535457 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1f2cd945-4db3-4f52-9383-edf42e1fd9c0 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:03.535876 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1f2cd945-4db3-4f52-9383-edf42e1fd9c0 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:03.536307 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1f2cd945-4db3-4f52-9383-edf42e1fd9c0 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:03.536993 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1f2cd945-4db3-4f52-9383-edf42e1fd9c0 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:03.537438 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1f2cd945-4db3-4f52-9383-edf42e1fd9c0 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:03.537854 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1f2cd945-4db3-4f52-9383-edf42e1fd9c0 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:03.670498 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-1f2cd945-4db3-4f52-9383-edf42e1fd9c0 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:03.678134 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-1f2cd945-4db3-4f52-9383-edf42e1fd9c0 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1550 microversion: 2.1 time: 0.153550 Aug 09 18:23:03.678736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 335/693] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:03 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:04.136900 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-0117057e-2287-47cf-b912-b74df95ce35d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:04.137563 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-0117057e-2287-47cf-b912-b74df95ce35d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:04.144030 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0117057e-2287-47cf-b912-b74df95ce35d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:04.145201 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0117057e-2287-47cf-b912-b74df95ce35d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:04.145201 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0117057e-2287-47cf-b912-b74df95ce35d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:04.145648 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0117057e-2287-47cf-b912-b74df95ce35d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:04.146101 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0117057e-2287-47cf-b912-b74df95ce35d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:04.146521 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0117057e-2287-47cf-b912-b74df95ce35d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:04.287380 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-0117057e-2287-47cf-b912-b74df95ce35d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:04.296821 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-0117057e-2287-47cf-b912-b74df95ce35d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1678 microversion: 2.1 time: 0.164150 Aug 09 18:23:04.297806 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 359/694] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:04 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:04.398513 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-69139ff5-4f57-4dc0-8cb4-f2b39b99e431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1445641474", "imageRef": "53732c26-c942-4646-ac3f-8d9e11ab4d57", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41cec70a-6176-4317-97fd-9218f52e1ff9"}], "security_groups": [{"name": "tempest-securitygroup--623579318"}], "key_name": "tempest-keypair-383451288", "user_data": "}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:23:04.502471 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.network.neutron [None req-69139ff5-4f57-4dc0-8cb4-f2b39b99e431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] validate_networks() for [('41cec70a-6176-4317-97fd-9218f52e1ff9', None, None, None, None, None)] {{(pid=118314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:23:04.868460 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-69139ff5-4f57-4dc0-8cb4-f2b39b99e431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Flavor limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:23:04.868889 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-69139ff5-4f57-4dc0-8cb4-f2b39b99e431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Image limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:23:04.869451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-69139ff5-4f57-4dc0-8cb4-f2b39b99e431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Flavor pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:23:04.869865 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-69139ff5-4f57-4dc0-8cb4-f2b39b99e431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Image pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:23:04.870277 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-69139ff5-4f57-4dc0-8cb4-f2b39b99e431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:23:04.879278 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-69139ff5-4f57-4dc0-8cb4-f2b39b99e431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:04.879761 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-69139ff5-4f57-4dc0-8cb4-f2b39b99e431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:04.880200 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-69139ff5-4f57-4dc0-8cb4-f2b39b99e431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:04.880923 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-69139ff5-4f57-4dc0-8cb4-f2b39b99e431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:04.881380 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-69139ff5-4f57-4dc0-8cb4-f2b39b99e431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:04.881807 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-69139ff5-4f57-4dc0-8cb4-f2b39b99e431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:04.899386 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-69139ff5-4f57-4dc0-8cb4-f2b39b99e431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Getting quotas for project ac2e5c4bafff4b16bb9d82dacb5dd056. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:23:04.904187 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-69139ff5-4f57-4dc0-8cb4-f2b39b99e431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Getting quotas for user 528811040ede40bdb40e3e6e666d283d and project ac2e5c4bafff4b16bb9d82dacb5dd056. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:23:04.915163 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-69139ff5-4f57-4dc0-8cb4-f2b39b99e431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Going to run 1 instances... {{(pid=118314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:23:04.917595 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-69139ff5-4f57-4dc0-8cb4-f2b39b99e431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53732c26-c942-4646-ac3f-8d9e11ab4d57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:23:05.104115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-69139ff5-4f57-4dc0-8cb4-f2b39b99e431 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.709786 Aug 09 18:23:05.104920 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 336/695] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Aug 9 18:23:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 18:23:05.115896 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-985f2f80-d42b-47eb-9c7f-2d42a055e2fa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:05.116508 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-985f2f80-d42b-47eb-9c7f-2d42a055e2fa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:05.171653 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-985f2f80-d42b-47eb-9c7f-2d42a055e2fa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:05.178956 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-985f2f80-d42b-47eb-9c7f-2d42a055e2fa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:05.180515 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-985f2f80-d42b-47eb-9c7f-2d42a055e2fa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:05.181716 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-985f2f80-d42b-47eb-9c7f-2d42a055e2fa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1281 microversion: 2.20 time: 0.069675 Aug 09 18:23:05.182535 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 360/696] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:23:05 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:23:05.318669 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8f17d362-ceec-442b-8f24-2bb78c9d8263 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:05.319304 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8f17d362-ceec-442b-8f24-2bb78c9d8263 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:05.325612 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8f17d362-ceec-442b-8f24-2bb78c9d8263 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:05.333377 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8f17d362-ceec-442b-8f24-2bb78c9d8263 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:05.333377 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8f17d362-ceec-442b-8f24-2bb78c9d8263 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:05.333377 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8f17d362-ceec-442b-8f24-2bb78c9d8263 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:05.333377 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8f17d362-ceec-442b-8f24-2bb78c9d8263 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:05.333841 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8f17d362-ceec-442b-8f24-2bb78c9d8263 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:05.474825 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8f17d362-ceec-442b-8f24-2bb78c9d8263 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:05.483317 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8f17d362-ceec-442b-8f24-2bb78c9d8263 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1678 microversion: 2.1 time: 0.168661 Aug 09 18:23:05.484007 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 337/697] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:05 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:05.588778 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c662e570-3dd5-4832-acf1-880cc4a0cd0b tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "936a5271-864e-4152-a322-84f2cfb8d3ac"}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:23:05.591152 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-c662e570-3dd5-4832-acf1-880cc4a0cd0b tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:05.598673 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c662e570-3dd5-4832-acf1-880cc4a0cd0b tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:05.599186 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c662e570-3dd5-4832-acf1-880cc4a0cd0b tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:05.602142 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c662e570-3dd5-4832-acf1-880cc4a0cd0b tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:05.602142 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c662e570-3dd5-4832-acf1-880cc4a0cd0b tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:05.602142 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c662e570-3dd5-4832-acf1-880cc4a0cd0b tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:05.602142 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c662e570-3dd5-4832-acf1-880cc4a0cd0b tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:06.204526 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-14f645b5-0ee6-42af-a5b4-d63ab640c4f4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:06.205140 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-14f645b5-0ee6-42af-a5b4-d63ab640c4f4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:06.211106 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-14f645b5-0ee6-42af-a5b4-d63ab640c4f4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:06.211616 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-14f645b5-0ee6-42af-a5b4-d63ab640c4f4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:06.213757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-14f645b5-0ee6-42af-a5b4-d63ab640c4f4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:06.213757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-14f645b5-0ee6-42af-a5b4-d63ab640c4f4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:06.213757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-14f645b5-0ee6-42af-a5b4-d63ab640c4f4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:06.213757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-14f645b5-0ee6-42af-a5b4-d63ab640c4f4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:06.275037 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-14f645b5-0ee6-42af-a5b4-d63ab640c4f4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:06.283213 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-14f645b5-0ee6-42af-a5b4-d63ab640c4f4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:06.284779 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-14f645b5-0ee6-42af-a5b4-d63ab640c4f4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:06.285877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-14f645b5-0ee6-42af-a5b4-d63ab640c4f4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1285 microversion: 2.20 time: 0.085456 Aug 09 18:23:06.286480 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 338/698] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:23:06 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:23:06.377980 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-c662e570-3dd5-4832-acf1-880cc4a0cd0b tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "POST /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.792907 Aug 09 18:23:06.378643 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 361/699] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Aug 9 18:23:05 2022] POST /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8/os-volume_attachments => generated 194 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:23:06.509715 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-dbbb03c9-c8c9-45b7-90fb-2ab037f8001b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:06.510432 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-dbbb03c9-c8c9-45b7-90fb-2ab037f8001b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:06.517351 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dbbb03c9-c8c9-45b7-90fb-2ab037f8001b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:06.517846 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dbbb03c9-c8c9-45b7-90fb-2ab037f8001b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:06.519883 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dbbb03c9-c8c9-45b7-90fb-2ab037f8001b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:06.519883 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dbbb03c9-c8c9-45b7-90fb-2ab037f8001b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:06.519883 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dbbb03c9-c8c9-45b7-90fb-2ab037f8001b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:06.520494 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dbbb03c9-c8c9-45b7-90fb-2ab037f8001b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:06.656929 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-dbbb03c9-c8c9-45b7-90fb-2ab037f8001b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:06.664711 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-dbbb03c9-c8c9-45b7-90fb-2ab037f8001b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1678 microversion: 2.1 time: 0.158906 Aug 09 18:23:06.665289 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 339/700] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:06 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:07.310775 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-ba38b661-0587-4e0e-a163-b348c1bc4181 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:07.311500 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-ba38b661-0587-4e0e-a163-b348c1bc4181 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:07.317656 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ba38b661-0587-4e0e-a163-b348c1bc4181 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:07.318147 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ba38b661-0587-4e0e-a163-b348c1bc4181 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:07.318583 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ba38b661-0587-4e0e-a163-b348c1bc4181 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:07.319354 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ba38b661-0587-4e0e-a163-b348c1bc4181 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:07.319807 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ba38b661-0587-4e0e-a163-b348c1bc4181 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:07.320233 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ba38b661-0587-4e0e-a163-b348c1bc4181 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:07.390116 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ba38b661-0587-4e0e-a163-b348c1bc4181 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:07.399510 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ba38b661-0587-4e0e-a163-b348c1bc4181 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:07.401073 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ba38b661-0587-4e0e-a163-b348c1bc4181 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:07.402576 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-ba38b661-0587-4e0e-a163-b348c1bc4181 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1341 microversion: 2.20 time: 0.097029 Aug 09 18:23:07.403330 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 362/701] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:23:07 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1341 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:23:07.686849 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-79c70be5-b848-4e4e-95c1-85b8992b65db tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:07.687461 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-79c70be5-b848-4e4e-95c1-85b8992b65db tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:07.693715 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79c70be5-b848-4e4e-95c1-85b8992b65db tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:07.694408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79c70be5-b848-4e4e-95c1-85b8992b65db tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:07.694873 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79c70be5-b848-4e4e-95c1-85b8992b65db tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:07.695564 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79c70be5-b848-4e4e-95c1-85b8992b65db tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:07.696014 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79c70be5-b848-4e4e-95c1-85b8992b65db tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:07.696652 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79c70be5-b848-4e4e-95c1-85b8992b65db tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:07.831141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-79c70be5-b848-4e4e-95c1-85b8992b65db tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:07.838570 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-79c70be5-b848-4e4e-95c1-85b8992b65db tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1678 microversion: 2.1 time: 0.155966 Aug 09 18:23:07.839721 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 340/702] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:07 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:08.425590 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d5ebca22-8a4c-47c1-a63a-40a10a0460d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:08.426201 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d5ebca22-8a4c-47c1-a63a-40a10a0460d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:08.432168 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d5ebca22-8a4c-47c1-a63a-40a10a0460d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:08.433299 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d5ebca22-8a4c-47c1-a63a-40a10a0460d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:08.438875 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d5ebca22-8a4c-47c1-a63a-40a10a0460d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:08.438875 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d5ebca22-8a4c-47c1-a63a-40a10a0460d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:08.438875 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d5ebca22-8a4c-47c1-a63a-40a10a0460d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:08.438875 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d5ebca22-8a4c-47c1-a63a-40a10a0460d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:08.577878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d5ebca22-8a4c-47c1-a63a-40a10a0460d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:08.586364 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d5ebca22-8a4c-47c1-a63a-40a10a0460d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:08.588206 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d5ebca22-8a4c-47c1-a63a-40a10a0460d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:08.589400 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d5ebca22-8a4c-47c1-a63a-40a10a0460d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1406 microversion: 2.20 time: 0.167834 Aug 09 18:23:08.589958 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 363/703] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:23:08 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:23:08.790459 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-3dee50fc-f9b6-4887-9275-e6d0eae1e492 req-e9ceb510-3b64-46ca-92eb-46f006d6e5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "262e54dc-8819-4689-ad3a-577f966f5a21", "tag": "0326ddaa-6e24-40bf-9ac7-991d3e2669c4"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:23:08.797738 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:23:08.801545 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-3dee50fc-f9b6-4887-9275-e6d0eae1e492 req-e9ceb510-3b64-46ca-92eb-46f006d6e5b2 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:08.802018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-3dee50fc-f9b6-4887-9275-e6d0eae1e492 req-e9ceb510-3b64-46ca-92eb-46f006d6e5b2 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:08.802447 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-3dee50fc-f9b6-4887-9275-e6d0eae1e492 req-e9ceb510-3b64-46ca-92eb-46f006d6e5b2 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:08.815784 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-3dee50fc-f9b6-4887-9275-e6d0eae1e492 req-e9ceb510-3b64-46ca-92eb-46f006d6e5b2 service nova] Creating event network-changed:0326ddaa-6e24-40bf-9ac7-991d3e2669c4 for instance 262e54dc-8819-4689-ad3a-577f966f5a21 on hv-cinder-79797 Aug 09 18:23:08.820715 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-3dee50fc-f9b6-4887-9275-e6d0eae1e492 req-e9ceb510-3b64-46ca-92eb-46f006d6e5b2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033777 Aug 09 18:23:08.821374 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 341/704] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:23:08.861409 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a6483833-706b-4b65-a85a-3abc889f5af7 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:08.863083 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a6483833-706b-4b65-a85a-3abc889f5af7 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:08.869723 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a6483833-706b-4b65-a85a-3abc889f5af7 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:08.870295 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a6483833-706b-4b65-a85a-3abc889f5af7 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:08.870893 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a6483833-706b-4b65-a85a-3abc889f5af7 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:08.874775 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a6483833-706b-4b65-a85a-3abc889f5af7 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:08.874775 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a6483833-706b-4b65-a85a-3abc889f5af7 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:08.874775 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a6483833-706b-4b65-a85a-3abc889f5af7 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:09.005682 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a6483833-706b-4b65-a85a-3abc889f5af7 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:09.013344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a6483833-706b-4b65-a85a-3abc889f5af7 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1678 microversion: 2.1 time: 0.156144 Aug 09 18:23:09.017874 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 364/705] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:08 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:23:09.613709 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-a992a219-bb5a-4748-b94a-d9782cee83b7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:09.614642 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-a992a219-bb5a-4748-b94a-d9782cee83b7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:09.622234 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a992a219-bb5a-4748-b94a-d9782cee83b7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:09.622994 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a992a219-bb5a-4748-b94a-d9782cee83b7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:09.623423 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a992a219-bb5a-4748-b94a-d9782cee83b7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:09.624112 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a992a219-bb5a-4748-b94a-d9782cee83b7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:09.624552 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a992a219-bb5a-4748-b94a-d9782cee83b7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:09.625170 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a992a219-bb5a-4748-b94a-d9782cee83b7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:09.643958 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:23:09.760162 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a992a219-bb5a-4748-b94a-d9782cee83b7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:09.768357 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a992a219-bb5a-4748-b94a-d9782cee83b7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:09.769906 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a992a219-bb5a-4748-b94a-d9782cee83b7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:09.771133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-a992a219-bb5a-4748-b94a-d9782cee83b7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1406 microversion: 2.20 time: 0.161692 Aug 09 18:23:09.771713 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 342/706] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:23:09 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:23:10.036580 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-de72d56c-4590-4581-9dba-4e27fb34c5f9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:10.037105 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-de72d56c-4590-4581-9dba-4e27fb34c5f9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:10.044164 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-de72d56c-4590-4581-9dba-4e27fb34c5f9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:10.044643 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-de72d56c-4590-4581-9dba-4e27fb34c5f9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:10.045073 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-de72d56c-4590-4581-9dba-4e27fb34c5f9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:10.045750 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-de72d56c-4590-4581-9dba-4e27fb34c5f9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:10.046225 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-de72d56c-4590-4581-9dba-4e27fb34c5f9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:10.046644 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-de72d56c-4590-4581-9dba-4e27fb34c5f9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:10.202509 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-de72d56c-4590-4581-9dba-4e27fb34c5f9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:10.210121 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-de72d56c-4590-4581-9dba-4e27fb34c5f9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1678 microversion: 2.1 time: 0.177369 Aug 09 18:23:10.210734 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 365/707] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:10 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:10.794101 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e7706ed7-2351-4fc1-b3e9-ac682fa6a63b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:10.794728 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e7706ed7-2351-4fc1-b3e9-ac682fa6a63b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:10.803130 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7706ed7-2351-4fc1-b3e9-ac682fa6a63b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:10.803618 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7706ed7-2351-4fc1-b3e9-ac682fa6a63b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:10.804058 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7706ed7-2351-4fc1-b3e9-ac682fa6a63b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:10.804755 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7706ed7-2351-4fc1-b3e9-ac682fa6a63b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:10.805212 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7706ed7-2351-4fc1-b3e9-ac682fa6a63b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:10.805631 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e7706ed7-2351-4fc1-b3e9-ac682fa6a63b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:10.934537 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e7706ed7-2351-4fc1-b3e9-ac682fa6a63b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:10.943069 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e7706ed7-2351-4fc1-b3e9-ac682fa6a63b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:10.944562 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e7706ed7-2351-4fc1-b3e9-ac682fa6a63b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:10.945658 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e7706ed7-2351-4fc1-b3e9-ac682fa6a63b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1406 microversion: 2.20 time: 0.156065 Aug 09 18:23:10.946215 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 343/708] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:23:10 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:23:11.232205 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-23422c42-452b-42f6-895e-3651c811e4c8 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:11.232815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-23422c42-452b-42f6-895e-3651c811e4c8 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:11.239466 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-23422c42-452b-42f6-895e-3651c811e4c8 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:11.239950 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-23422c42-452b-42f6-895e-3651c811e4c8 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:11.240391 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-23422c42-452b-42f6-895e-3651c811e4c8 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:11.241071 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-23422c42-452b-42f6-895e-3651c811e4c8 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:11.241527 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-23422c42-452b-42f6-895e-3651c811e4c8 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:11.241949 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-23422c42-452b-42f6-895e-3651c811e4c8 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:11.371908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-23422c42-452b-42f6-895e-3651c811e4c8 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:11.379569 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-23422c42-452b-42f6-895e-3651c811e4c8 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1678 microversion: 2.1 time: 0.151755 Aug 09 18:23:11.380136 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 366/709] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:11 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:11.967811 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-de443353-4aa0-42e8-819c-9edb41a11d1b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:11.970209 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-de443353-4aa0-42e8-819c-9edb41a11d1b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:11.975052 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-de443353-4aa0-42e8-819c-9edb41a11d1b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:11.975535 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-de443353-4aa0-42e8-819c-9edb41a11d1b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:11.976018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-de443353-4aa0-42e8-819c-9edb41a11d1b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:11.976710 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-de443353-4aa0-42e8-819c-9edb41a11d1b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:11.977159 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-de443353-4aa0-42e8-819c-9edb41a11d1b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:11.977583 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-de443353-4aa0-42e8-819c-9edb41a11d1b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:12.112387 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-de443353-4aa0-42e8-819c-9edb41a11d1b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:12.121338 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-de443353-4aa0-42e8-819c-9edb41a11d1b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:12.122892 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-de443353-4aa0-42e8-819c-9edb41a11d1b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:12.123997 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-de443353-4aa0-42e8-819c-9edb41a11d1b tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1406 microversion: 2.20 time: 0.160265 Aug 09 18:23:12.124558 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 344/710] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:23:11 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:23:12.400978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f3506560-f952-44e2-bbeb-7710c408e35f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:12.401808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f3506560-f952-44e2-bbeb-7710c408e35f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:12.408137 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f3506560-f952-44e2-bbeb-7710c408e35f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:12.408616 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f3506560-f952-44e2-bbeb-7710c408e35f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:12.409048 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f3506560-f952-44e2-bbeb-7710c408e35f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:12.409726 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f3506560-f952-44e2-bbeb-7710c408e35f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:12.410178 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f3506560-f952-44e2-bbeb-7710c408e35f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:12.410596 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f3506560-f952-44e2-bbeb-7710c408e35f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:12.537224 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f3506560-f952-44e2-bbeb-7710c408e35f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:12.545240 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f3506560-f952-44e2-bbeb-7710c408e35f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1678 microversion: 2.1 time: 0.148077 Aug 09 18:23:12.545811 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 367/711] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:12 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:13.146663 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-be7e8734-894b-4e47-b549-8e6353a6f965 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:13.147227 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-be7e8734-894b-4e47-b549-8e6353a6f965 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:13.154423 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-be7e8734-894b-4e47-b549-8e6353a6f965 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:13.154939 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-be7e8734-894b-4e47-b549-8e6353a6f965 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:13.155373 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-be7e8734-894b-4e47-b549-8e6353a6f965 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:13.156059 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-be7e8734-894b-4e47-b549-8e6353a6f965 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:13.156509 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-be7e8734-894b-4e47-b549-8e6353a6f965 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:13.156930 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-be7e8734-894b-4e47-b549-8e6353a6f965 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:13.286852 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-be7e8734-894b-4e47-b549-8e6353a6f965 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:13.294858 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-be7e8734-894b-4e47-b549-8e6353a6f965 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:13.296359 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-be7e8734-894b-4e47-b549-8e6353a6f965 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:13.297452 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-be7e8734-894b-4e47-b549-8e6353a6f965 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1406 microversion: 2.20 time: 0.154830 Aug 09 18:23:13.298017 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 345/712] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:23:13 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:23:13.567209 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2b849783-6833-409a-8f7e-117e5fd7b15a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:13.567971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-2b849783-6833-409a-8f7e-117e5fd7b15a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:13.570082 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=2 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:23:13.576369 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2b849783-6833-409a-8f7e-117e5fd7b15a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:13.576944 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2b849783-6833-409a-8f7e-117e5fd7b15a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:13.577391 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2b849783-6833-409a-8f7e-117e5fd7b15a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:13.578095 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2b849783-6833-409a-8f7e-117e5fd7b15a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:13.578555 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2b849783-6833-409a-8f7e-117e5fd7b15a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:13.579108 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2b849783-6833-409a-8f7e-117e5fd7b15a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:13.709870 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-2b849783-6833-409a-8f7e-117e5fd7b15a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:13.718191 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-2b849783-6833-409a-8f7e-117e5fd7b15a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1678 microversion: 2.1 time: 0.154730 Aug 09 18:23:13.718698 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 368/713] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:13 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:13.977364 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8e245d5e-7dfa-486c-af8a-6f78545606e7 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:13.977364 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8e245d5e-7dfa-486c-af8a-6f78545606e7 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:13.983676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e245d5e-7dfa-486c-af8a-6f78545606e7 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:13.984154 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e245d5e-7dfa-486c-af8a-6f78545606e7 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:13.984581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e245d5e-7dfa-486c-af8a-6f78545606e7 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:13.985512 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e245d5e-7dfa-486c-af8a-6f78545606e7 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:13.985955 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e245d5e-7dfa-486c-af8a-6f78545606e7 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:13.986373 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e245d5e-7dfa-486c-af8a-6f78545606e7 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:14.118325 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8e245d5e-7dfa-486c-af8a-6f78545606e7 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:14.126747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8e245d5e-7dfa-486c-af8a-6f78545606e7 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1596 microversion: 2.1 time: 0.154195 Aug 09 18:23:14.127313 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 346/714] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:13 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1596 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:14.320407 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b2bf9f9e-e839-4366-afa5-58dc24dc86bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:14.321013 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-b2bf9f9e-e839-4366-afa5-58dc24dc86bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:14.327575 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b2bf9f9e-e839-4366-afa5-58dc24dc86bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:14.328061 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b2bf9f9e-e839-4366-afa5-58dc24dc86bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:14.328490 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b2bf9f9e-e839-4366-afa5-58dc24dc86bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:14.329174 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b2bf9f9e-e839-4366-afa5-58dc24dc86bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:14.329624 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b2bf9f9e-e839-4366-afa5-58dc24dc86bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:14.330044 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b2bf9f9e-e839-4366-afa5-58dc24dc86bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:14.740333 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e016f3a0-c80f-4c4d-9ebd-71efb1f13db1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:14.741037 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e016f3a0-c80f-4c4d-9ebd-71efb1f13db1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:14.748076 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e016f3a0-c80f-4c4d-9ebd-71efb1f13db1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:14.748567 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e016f3a0-c80f-4c4d-9ebd-71efb1f13db1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:14.749005 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e016f3a0-c80f-4c4d-9ebd-71efb1f13db1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:14.749701 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e016f3a0-c80f-4c4d-9ebd-71efb1f13db1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:14.750154 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e016f3a0-c80f-4c4d-9ebd-71efb1f13db1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:14.750584 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e016f3a0-c80f-4c4d-9ebd-71efb1f13db1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:14.759665 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b2bf9f9e-e839-4366-afa5-58dc24dc86bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:14.768735 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b2bf9f9e-e839-4366-afa5-58dc24dc86bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:14.770206 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b2bf9f9e-e839-4366-afa5-58dc24dc86bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:14.771451 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b2bf9f9e-e839-4366-afa5-58dc24dc86bb tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1406 microversion: 2.20 time: 0.454969 Aug 09 18:23:14.786216 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 369/715] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:23:14 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1406 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:23:14.889992 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=2 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:23:14.910794 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=10 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:23:14.965537 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e016f3a0-c80f-4c4d-9ebd-71efb1f13db1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:14.973320 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e016f3a0-c80f-4c4d-9ebd-71efb1f13db1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1655 microversion: 2.1 time: 0.236712 Aug 09 18:23:14.974233 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 347/716] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:14 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1655 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:23:14.994981 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-34184526-ce30-4f6f-9b89-aae29119541c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:23:15.001664 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-34184526-ce30-4f6f-9b89-aae29119541c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:15.002161 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-34184526-ce30-4f6f-9b89-aae29119541c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:15.002597 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-34184526-ce30-4f6f-9b89-aae29119541c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:15.025386 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-34184526-ce30-4f6f-9b89-aae29119541c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Going to try to start instance {{(pid=118313) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 18:23:15.031596 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:23:15.175777 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=2 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:23:15.232057 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-34184526-ce30-4f6f-9b89-aae29119541c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "POST /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e/action" status: 202 len: 0 microversion: 2.1 time: 0.240820 Aug 09 18:23:15.232675 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 370/717] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Aug 9 18:23:14 2022] POST /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:23:15.241040 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8307bd5c-cd25-4339-8b44-b231d55a0db5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:15.241745 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8307bd5c-cd25-4339-8b44-b231d55a0db5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:15.249762 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8307bd5c-cd25-4339-8b44-b231d55a0db5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:15.250337 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8307bd5c-cd25-4339-8b44-b231d55a0db5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:15.250903 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8307bd5c-cd25-4339-8b44-b231d55a0db5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:15.251685 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8307bd5c-cd25-4339-8b44-b231d55a0db5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:15.252144 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8307bd5c-cd25-4339-8b44-b231d55a0db5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:15.252573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8307bd5c-cd25-4339-8b44-b231d55a0db5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:15.518425 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8307bd5c-cd25-4339-8b44-b231d55a0db5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:15.526052 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8307bd5c-cd25-4339-8b44-b231d55a0db5 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1664 microversion: 2.1 time: 0.288713 Aug 09 18:23:15.539503 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 348/718] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:15 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1664 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:15.798297 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-83172f50-6349-40db-a3fc-5497569a11d6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:15.799144 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-83172f50-6349-40db-a3fc-5497569a11d6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:15.805669 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-83172f50-6349-40db-a3fc-5497569a11d6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:15.806254 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-83172f50-6349-40db-a3fc-5497569a11d6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:15.806792 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-83172f50-6349-40db-a3fc-5497569a11d6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:15.807551 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-83172f50-6349-40db-a3fc-5497569a11d6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:15.808078 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-83172f50-6349-40db-a3fc-5497569a11d6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:15.808694 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-83172f50-6349-40db-a3fc-5497569a11d6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:15.987059 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-83172f50-6349-40db-a3fc-5497569a11d6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:15.995106 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-83172f50-6349-40db-a3fc-5497569a11d6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:15.996708 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-83172f50-6349-40db-a3fc-5497569a11d6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:15.997886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-83172f50-6349-40db-a3fc-5497569a11d6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1406 microversion: 2.20 time: 0.205215 Aug 09 18:23:15.998443 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 371/719] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:23:15 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:23:16.525560 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-4dcb73a7-8f12-40f2-b857-c46929a47b35 req-f9ab0bc8-5e22-4688-a2fc-6ccf686c2578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262e54dc-8819-4689-ad3a-577f966f5a21", "name": "network-vif-plugged", "status": "completed", "tag": "0326ddaa-6e24-40bf-9ac7-991d3e2669c4"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:23:16.539789 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-4dcb73a7-8f12-40f2-b857-c46929a47b35 req-f9ab0bc8-5e22-4688-a2fc-6ccf686c2578 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:16.539789 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-4dcb73a7-8f12-40f2-b857-c46929a47b35 req-f9ab0bc8-5e22-4688-a2fc-6ccf686c2578 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:16.539789 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-4dcb73a7-8f12-40f2-b857-c46929a47b35 req-f9ab0bc8-5e22-4688-a2fc-6ccf686c2578 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:16.549181 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-4dcb73a7-8f12-40f2-b857-c46929a47b35 req-f9ab0bc8-5e22-4688-a2fc-6ccf686c2578 service nova] Creating event network-vif-plugged:0326ddaa-6e24-40bf-9ac7-991d3e2669c4 for instance 262e54dc-8819-4689-ad3a-577f966f5a21 on hv-cinder-79797 Aug 09 18:23:16.549455 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-0e1c7993-0738-4984-a5cb-d23ed0c0c406 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:16.550063 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-0e1c7993-0738-4984-a5cb-d23ed0c0c406 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:16.554101 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-4dcb73a7-8f12-40f2-b857-c46929a47b35 req-f9ab0bc8-5e22-4688-a2fc-6ccf686c2578 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034169 Aug 09 18:23:16.554697 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 349/720] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:23:16.565419 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0e1c7993-0738-4984-a5cb-d23ed0c0c406 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:16.566528 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0e1c7993-0738-4984-a5cb-d23ed0c0c406 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:16.566528 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0e1c7993-0738-4984-a5cb-d23ed0c0c406 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:16.567236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0e1c7993-0738-4984-a5cb-d23ed0c0c406 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:16.567689 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0e1c7993-0738-4984-a5cb-d23ed0c0c406 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:16.568138 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-0e1c7993-0738-4984-a5cb-d23ed0c0c406 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:16.692580 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-0b18b13c-89ca-45bd-bf62-f53447d82071 req-79a87fa9-6bdb-48eb-b4db-917b53ab3f4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "641782b3-69ae-49c4-bc58-608cf91d08f8", "tag": "6517c4a8-4f1c-427c-b492-618a0970aaef"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:23:16.702422 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-0b18b13c-89ca-45bd-bf62-f53447d82071 req-79a87fa9-6bdb-48eb-b4db-917b53ab3f4a service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:16.703308 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-0b18b13c-89ca-45bd-bf62-f53447d82071 req-79a87fa9-6bdb-48eb-b4db-917b53ab3f4a service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:16.704400 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-0b18b13c-89ca-45bd-bf62-f53447d82071 req-79a87fa9-6bdb-48eb-b4db-917b53ab3f4a service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:16.715595 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-0b18b13c-89ca-45bd-bf62-f53447d82071 req-79a87fa9-6bdb-48eb-b4db-917b53ab3f4a service nova] Creating event network-changed:6517c4a8-4f1c-427c-b492-618a0970aaef for instance 641782b3-69ae-49c4-bc58-608cf91d08f8 on hv-cinder-79797 Aug 09 18:23:16.720667 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-0b18b13c-89ca-45bd-bf62-f53447d82071 req-79a87fa9-6bdb-48eb-b4db-917b53ab3f4a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031902 Aug 09 18:23:16.721768 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 350/721] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:23:16.746819 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-0e1c7993-0738-4984-a5cb-d23ed0c0c406 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:16.754540 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-0e1c7993-0738-4984-a5cb-d23ed0c0c406 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1664 microversion: 2.1 time: 0.209092 Aug 09 18:23:16.755241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 372/722] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:16 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1664 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:17.026384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-88eaffdf-ce22-4dbf-88ba-46e3f497df5e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:17.026384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-88eaffdf-ce22-4dbf-88ba-46e3f497df5e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:17.032569 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-88eaffdf-ce22-4dbf-88ba-46e3f497df5e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:17.033419 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-88eaffdf-ce22-4dbf-88ba-46e3f497df5e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:17.034063 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-88eaffdf-ce22-4dbf-88ba-46e3f497df5e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:17.035070 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-88eaffdf-ce22-4dbf-88ba-46e3f497df5e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:17.035821 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-88eaffdf-ce22-4dbf-88ba-46e3f497df5e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:17.036660 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-88eaffdf-ce22-4dbf-88ba-46e3f497df5e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:17.198544 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-88eaffdf-ce22-4dbf-88ba-46e3f497df5e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:17.207018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-88eaffdf-ce22-4dbf-88ba-46e3f497df5e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:17.209129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-88eaffdf-ce22-4dbf-88ba-46e3f497df5e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:17.210396 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-88eaffdf-ce22-4dbf-88ba-46e3f497df5e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1406 microversion: 2.20 time: 0.192288 Aug 09 18:23:17.211052 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 351/723] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:23:17 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:23:17.775562 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-04388fba-cd3f-48a3-96a7-a8bda2eadfaa tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:17.776156 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-04388fba-cd3f-48a3-96a7-a8bda2eadfaa tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:17.789572 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-04388fba-cd3f-48a3-96a7-a8bda2eadfaa tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:17.789572 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-04388fba-cd3f-48a3-96a7-a8bda2eadfaa tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:17.789572 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-04388fba-cd3f-48a3-96a7-a8bda2eadfaa tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:17.789572 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-04388fba-cd3f-48a3-96a7-a8bda2eadfaa tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:17.789923 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-04388fba-cd3f-48a3-96a7-a8bda2eadfaa tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:17.790241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-04388fba-cd3f-48a3-96a7-a8bda2eadfaa tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:17.942510 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-04388fba-cd3f-48a3-96a7-a8bda2eadfaa tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:17.951158 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-04388fba-cd3f-48a3-96a7-a8bda2eadfaa tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1668 microversion: 2.1 time: 0.179351 Aug 09 18:23:17.951742 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 373/724] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:17 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1668 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:18.235370 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d44b3b5a-c7c1-460c-ab1c-e765dbd4f3b5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:18.235984 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d44b3b5a-c7c1-460c-ab1c-e765dbd4f3b5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:18.242830 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d44b3b5a-c7c1-460c-ab1c-e765dbd4f3b5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:18.243407 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d44b3b5a-c7c1-460c-ab1c-e765dbd4f3b5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:18.243854 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d44b3b5a-c7c1-460c-ab1c-e765dbd4f3b5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:18.244606 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d44b3b5a-c7c1-460c-ab1c-e765dbd4f3b5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:18.245127 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d44b3b5a-c7c1-460c-ab1c-e765dbd4f3b5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:18.245569 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d44b3b5a-c7c1-460c-ab1c-e765dbd4f3b5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:18.376393 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d44b3b5a-c7c1-460c-ab1c-e765dbd4f3b5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:18.384419 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d44b3b5a-c7c1-460c-ab1c-e765dbd4f3b5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:18.385928 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d44b3b5a-c7c1-460c-ab1c-e765dbd4f3b5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:18.387170 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d44b3b5a-c7c1-460c-ab1c-e765dbd4f3b5 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1406 microversion: 2.20 time: 0.156034 Aug 09 18:23:18.387758 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 352/725] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:23:18 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:23:19.410004 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2953b957-d166-45d4-b01d-0d8d94d28153 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:19.410620 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-2953b957-d166-45d4-b01d-0d8d94d28153 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:19.417255 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2953b957-d166-45d4-b01d-0d8d94d28153 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:19.417747 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2953b957-d166-45d4-b01d-0d8d94d28153 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:19.418536 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2953b957-d166-45d4-b01d-0d8d94d28153 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:19.419612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2953b957-d166-45d4-b01d-0d8d94d28153 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:19.420072 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2953b957-d166-45d4-b01d-0d8d94d28153 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:19.420493 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2953b957-d166-45d4-b01d-0d8d94d28153 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:19.543312 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-579db230-8d48-4999-b71d-3252a7425f22 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-292785487"}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:23:19.544030 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-579db230-8d48-4999-b71d-3252a7425f22 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:19.550298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-579db230-8d48-4999-b71d-3252a7425f22 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:19.550814 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-579db230-8d48-4999-b71d-3252a7425f22 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:19.551249 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-579db230-8d48-4999-b71d-3252a7425f22 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:19.551930 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-579db230-8d48-4999-b71d-3252a7425f22 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:19.552373 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-579db230-8d48-4999-b71d-3252a7425f22 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:19.552790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-579db230-8d48-4999-b71d-3252a7425f22 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:19.556600 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-2953b957-d166-45d4-b01d-0d8d94d28153 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:19.565427 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-2953b957-d166-45d4-b01d-0d8d94d28153 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:19.566994 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-2953b957-d166-45d4-b01d-0d8d94d28153 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:19.568186 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-2953b957-d166-45d4-b01d-0d8d94d28153 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1599 microversion: 2.20 time: 0.162516 Aug 09 18:23:19.568745 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 374/726] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:23:19 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:23:19.597151 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-bc9ddad5-2c87-4779-a5a0-a59f81506413 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:19.597646 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-bc9ddad5-2c87-4779-a5a0-a59f81506413 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:19.603761 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bc9ddad5-2c87-4779-a5a0-a59f81506413 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:19.604250 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bc9ddad5-2c87-4779-a5a0-a59f81506413 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:19.604684 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bc9ddad5-2c87-4779-a5a0-a59f81506413 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:19.605730 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bc9ddad5-2c87-4779-a5a0-a59f81506413 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:19.606531 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bc9ddad5-2c87-4779-a5a0-a59f81506413 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:19.607340 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bc9ddad5-2c87-4779-a5a0-a59f81506413 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:19.713032 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.network.security_group_api [None req-579db230-8d48-4999-b71d-3252a7425f22 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Adding security group ebe5873c-5f1e-4e62-822a-1d575b0a6b53 to port 6517c4a8-4f1c-427c-b492-618a0970aaef Aug 09 18:23:19.721485 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-bc9ddad5-2c87-4779-a5a0-a59f81506413 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.128415 Aug 09 18:23:19.722093 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 375/727] 10.222.0.36 () {60 vars in 1316 bytes} [Tue Aug 9 18:23:19 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:23:20.694884 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-579db230-8d48-4999-b71d-3252a7425f22 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "POST /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8/action" status: 202 len: 0 microversion: 2.1 time: 1.155711 Aug 09 18:23:20.696125 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 353/728] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Aug 9 18:23:19 2022] POST /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8/action => generated 0 bytes in 1157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:23:20.710133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d8d7b645-97ad-424c-a52b-3757763e84fd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:20.710956 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-c5fc28b1-43da-448a-ab93-655a0891b264 req-c786b1b6-24bd-4ccd-b681-6959ea83ce1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "641782b3-69ae-49c4-bc58-608cf91d08f8", "tag": "6517c4a8-4f1c-427c-b492-618a0970aaef"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:23:20.711751 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d8d7b645-97ad-424c-a52b-3757763e84fd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:20.721561 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d8d7b645-97ad-424c-a52b-3757763e84fd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:20.722309 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d8d7b645-97ad-424c-a52b-3757763e84fd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:20.723679 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d8d7b645-97ad-424c-a52b-3757763e84fd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:20.724736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d8d7b645-97ad-424c-a52b-3757763e84fd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:20.725398 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d8d7b645-97ad-424c-a52b-3757763e84fd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:20.726099 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d8d7b645-97ad-424c-a52b-3757763e84fd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:20.753897 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-c5fc28b1-43da-448a-ab93-655a0891b264 req-c786b1b6-24bd-4ccd-b681-6959ea83ce1a service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:20.753897 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-c5fc28b1-43da-448a-ab93-655a0891b264 req-c786b1b6-24bd-4ccd-b681-6959ea83ce1a service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:20.753897 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-c5fc28b1-43da-448a-ab93-655a0891b264 req-c786b1b6-24bd-4ccd-b681-6959ea83ce1a service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:20.779212 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-c5fc28b1-43da-448a-ab93-655a0891b264 req-c786b1b6-24bd-4ccd-b681-6959ea83ce1a service nova] Creating event network-changed:6517c4a8-4f1c-427c-b492-618a0970aaef for instance 641782b3-69ae-49c4-bc58-608cf91d08f8 on hv-cinder-79797 Aug 09 18:23:20.788541 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-c5fc28b1-43da-448a-ab93-655a0891b264 req-c786b1b6-24bd-4ccd-b681-6959ea83ce1a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086402 Aug 09 18:23:20.789631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 376/729] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:23:20.970909 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d8d7b645-97ad-424c-a52b-3757763e84fd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:20.986433 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d8d7b645-97ad-424c-a52b-3757763e84fd tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1761 microversion: 2.1 time: 0.285235 Aug 09 18:23:20.987878 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 354/730] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:20 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1761 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:23:21.585046 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-aa3e235b-fdc7-4701-8050-430ad598eb99 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:23:21.585745 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-aa3e235b-fdc7-4701-8050-430ad598eb99 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:21.591853 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-aa3e235b-fdc7-4701-8050-430ad598eb99 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:21.592341 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-aa3e235b-fdc7-4701-8050-430ad598eb99 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:21.592794 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-aa3e235b-fdc7-4701-8050-430ad598eb99 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:21.593469 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-aa3e235b-fdc7-4701-8050-430ad598eb99 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:21.593924 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-aa3e235b-fdc7-4701-8050-430ad598eb99 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:21.594350 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-aa3e235b-fdc7-4701-8050-430ad598eb99 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:21.617166 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.objects.instance [None req-aa3e235b-fdc7-4701-8050-430ad598eb99 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lazy-loading 'flavor' on Instance uuid 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 {{(pid=118313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:23:21.880288 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-aa3e235b-fdc7-4701-8050-430ad598eb99 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "POST /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0/action" status: 202 len: 0 microversion: 2.1 time: 0.299375 Aug 09 18:23:21.880967 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 377/731] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Aug 9 18:23:21 2022] POST /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:23:21.890675 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f4d43d9f-c348-4f5e-b8d7-3d858c0e4204 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:21.891733 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f4d43d9f-c348-4f5e-b8d7-3d858c0e4204 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:21.897793 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f4d43d9f-c348-4f5e-b8d7-3d858c0e4204 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:21.898277 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f4d43d9f-c348-4f5e-b8d7-3d858c0e4204 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:21.898921 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f4d43d9f-c348-4f5e-b8d7-3d858c0e4204 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:21.899795 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f4d43d9f-c348-4f5e-b8d7-3d858c0e4204 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:21.900246 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f4d43d9f-c348-4f5e-b8d7-3d858c0e4204 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:21.900763 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f4d43d9f-c348-4f5e-b8d7-3d858c0e4204 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:22.042216 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f4d43d9f-c348-4f5e-b8d7-3d858c0e4204 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:22.050576 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f4d43d9f-c348-4f5e-b8d7-3d858c0e4204 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.165007 Aug 09 18:23:22.051280 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 355/732] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:21 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:22.806073 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-ea341606-16dd-4369-86ba-43367739d31d req-ad143f64-6bd8-474b-92aa-dc649764ac64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "262e54dc-8819-4689-ad3a-577f966f5a21", "tag": "0326ddaa-6e24-40bf-9ac7-991d3e2669c4"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:23:22.811875 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=72 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:23:22.817153 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-ea341606-16dd-4369-86ba-43367739d31d req-ad143f64-6bd8-474b-92aa-dc649764ac64 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:22.817633 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-ea341606-16dd-4369-86ba-43367739d31d req-ad143f64-6bd8-474b-92aa-dc649764ac64 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:22.818065 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-ea341606-16dd-4369-86ba-43367739d31d req-ad143f64-6bd8-474b-92aa-dc649764ac64 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:22.829200 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-ea341606-16dd-4369-86ba-43367739d31d req-ad143f64-6bd8-474b-92aa-dc649764ac64 service nova] Creating event network-changed:0326ddaa-6e24-40bf-9ac7-991d3e2669c4 for instance 262e54dc-8819-4689-ad3a-577f966f5a21 on hv-cinder-79797 Aug 09 18:23:22.834150 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-ea341606-16dd-4369-86ba-43367739d31d req-ad143f64-6bd8-474b-92aa-dc649764ac64 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032508 Aug 09 18:23:22.834749 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 378/733] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:23:23.073564 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-08e66744-cb18-4ad1-b387-7e4b5066f740 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:23.075645 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-08e66744-cb18-4ad1-b387-7e4b5066f740 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:23.081082 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-08e66744-cb18-4ad1-b387-7e4b5066f740 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:23.081592 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-08e66744-cb18-4ad1-b387-7e4b5066f740 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:23.082023 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-08e66744-cb18-4ad1-b387-7e4b5066f740 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:23.082727 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-08e66744-cb18-4ad1-b387-7e4b5066f740 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:23.083188 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-08e66744-cb18-4ad1-b387-7e4b5066f740 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:23.083606 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-08e66744-cb18-4ad1-b387-7e4b5066f740 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:23.222505 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-08e66744-cb18-4ad1-b387-7e4b5066f740 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:23.229937 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-08e66744-cb18-4ad1-b387-7e4b5066f740 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.160185 Aug 09 18:23:23.231384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 356/734] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:23 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:24.253851 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-07a15c03-a754-4f04-925b-d4cef1a44988 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:24.254544 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-07a15c03-a754-4f04-925b-d4cef1a44988 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:24.260987 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-07a15c03-a754-4f04-925b-d4cef1a44988 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:24.261522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-07a15c03-a754-4f04-925b-d4cef1a44988 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:24.262043 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-07a15c03-a754-4f04-925b-d4cef1a44988 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:24.262729 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-07a15c03-a754-4f04-925b-d4cef1a44988 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:24.263199 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-07a15c03-a754-4f04-925b-d4cef1a44988 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:24.263627 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-07a15c03-a754-4f04-925b-d4cef1a44988 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:24.394096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-07a15c03-a754-4f04-925b-d4cef1a44988 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:24.401854 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-07a15c03-a754-4f04-925b-d4cef1a44988 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.152743 Aug 09 18:23:24.402739 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 379/735] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:24 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:25.424358 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-52e3333b-35a0-42ab-9b52-30b1e6ffc985 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:25.424966 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-52e3333b-35a0-42ab-9b52-30b1e6ffc985 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:25.431419 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-52e3333b-35a0-42ab-9b52-30b1e6ffc985 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:25.431910 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-52e3333b-35a0-42ab-9b52-30b1e6ffc985 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:25.432340 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-52e3333b-35a0-42ab-9b52-30b1e6ffc985 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:25.433027 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-52e3333b-35a0-42ab-9b52-30b1e6ffc985 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:25.433478 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-52e3333b-35a0-42ab-9b52-30b1e6ffc985 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:25.434391 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-52e3333b-35a0-42ab-9b52-30b1e6ffc985 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:25.565626 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-52e3333b-35a0-42ab-9b52-30b1e6ffc985 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:25.573137 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-52e3333b-35a0-42ab-9b52-30b1e6ffc985 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.152695 Aug 09 18:23:25.574658 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 357/736] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:25 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:26.594607 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6e55c32e-9ada-4e35-af5b-8313de5ea64d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:26.595262 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-6e55c32e-9ada-4e35-af5b-8313de5ea64d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:26.601730 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e55c32e-9ada-4e35-af5b-8313de5ea64d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:26.602216 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e55c32e-9ada-4e35-af5b-8313de5ea64d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:26.602655 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e55c32e-9ada-4e35-af5b-8313de5ea64d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:26.603433 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e55c32e-9ada-4e35-af5b-8313de5ea64d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:26.603887 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e55c32e-9ada-4e35-af5b-8313de5ea64d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:26.604311 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e55c32e-9ada-4e35-af5b-8313de5ea64d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:26.738977 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6e55c32e-9ada-4e35-af5b-8313de5ea64d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:26.746548 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-6e55c32e-9ada-4e35-af5b-8313de5ea64d tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.155977 Aug 09 18:23:26.747194 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 380/737] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:26 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:27.768684 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-67244e25-8e3c-4af3-88c9-2daa905a5279 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:27.769295 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-67244e25-8e3c-4af3-88c9-2daa905a5279 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:27.775648 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-67244e25-8e3c-4af3-88c9-2daa905a5279 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:27.776130 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-67244e25-8e3c-4af3-88c9-2daa905a5279 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:27.776564 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-67244e25-8e3c-4af3-88c9-2daa905a5279 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:27.777274 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-67244e25-8e3c-4af3-88c9-2daa905a5279 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:27.777727 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-67244e25-8e3c-4af3-88c9-2daa905a5279 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:27.778146 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-67244e25-8e3c-4af3-88c9-2daa905a5279 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:27.910391 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-67244e25-8e3c-4af3-88c9-2daa905a5279 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:27.917950 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-67244e25-8e3c-4af3-88c9-2daa905a5279 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.153318 Aug 09 18:23:27.918518 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 358/738] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:27 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:23:28.939806 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a81c24fe-5983-4cff-8b25-242caa971025 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:28.940415 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a81c24fe-5983-4cff-8b25-242caa971025 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:28.946958 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a81c24fe-5983-4cff-8b25-242caa971025 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:28.947439 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a81c24fe-5983-4cff-8b25-242caa971025 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:28.947868 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a81c24fe-5983-4cff-8b25-242caa971025 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:28.948548 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a81c24fe-5983-4cff-8b25-242caa971025 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:28.949002 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a81c24fe-5983-4cff-8b25-242caa971025 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:28.949417 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a81c24fe-5983-4cff-8b25-242caa971025 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:29.083941 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a81c24fe-5983-4cff-8b25-242caa971025 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:29.091653 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a81c24fe-5983-4cff-8b25-242caa971025 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.155837 Aug 09 18:23:29.092220 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 381/739] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:28 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:30.113605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e282e02d-288e-4b8f-b085-2090b3f23431 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:30.114225 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e282e02d-288e-4b8f-b085-2090b3f23431 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:30.120649 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e282e02d-288e-4b8f-b085-2090b3f23431 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:30.121134 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e282e02d-288e-4b8f-b085-2090b3f23431 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:30.121569 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e282e02d-288e-4b8f-b085-2090b3f23431 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:30.122251 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e282e02d-288e-4b8f-b085-2090b3f23431 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:30.122723 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e282e02d-288e-4b8f-b085-2090b3f23431 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:30.123198 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e282e02d-288e-4b8f-b085-2090b3f23431 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:30.254154 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e282e02d-288e-4b8f-b085-2090b3f23431 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:30.261557 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e282e02d-288e-4b8f-b085-2090b3f23431 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.152191 Aug 09 18:23:30.262132 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 359/740] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:30 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:31.284133 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f083906b-1ae2-4da1-a32a-0b934317e618 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:31.284766 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f083906b-1ae2-4da1-a32a-0b934317e618 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:31.291151 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f083906b-1ae2-4da1-a32a-0b934317e618 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:31.291634 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f083906b-1ae2-4da1-a32a-0b934317e618 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:31.292069 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f083906b-1ae2-4da1-a32a-0b934317e618 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:31.292758 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f083906b-1ae2-4da1-a32a-0b934317e618 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:31.293212 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f083906b-1ae2-4da1-a32a-0b934317e618 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:31.293634 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f083906b-1ae2-4da1-a32a-0b934317e618 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:31.430732 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f083906b-1ae2-4da1-a32a-0b934317e618 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:31.438480 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f083906b-1ae2-4da1-a32a-0b934317e618 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.158151 Aug 09 18:23:31.439067 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 382/741] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:31 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:23:32.460113 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-a27f0499-4f5d-4b65-88fa-33236d6fa4a7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:32.460828 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-a27f0499-4f5d-4b65-88fa-33236d6fa4a7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:32.468042 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a27f0499-4f5d-4b65-88fa-33236d6fa4a7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:32.468520 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a27f0499-4f5d-4b65-88fa-33236d6fa4a7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:32.468950 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a27f0499-4f5d-4b65-88fa-33236d6fa4a7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:32.469637 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a27f0499-4f5d-4b65-88fa-33236d6fa4a7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:32.470083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a27f0499-4f5d-4b65-88fa-33236d6fa4a7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:32.470499 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a27f0499-4f5d-4b65-88fa-33236d6fa4a7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:32.600474 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a27f0499-4f5d-4b65-88fa-33236d6fa4a7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:32.603969 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=100 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:23:32.608354 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-a27f0499-4f5d-4b65-88fa-33236d6fa4a7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.152066 Aug 09 18:23:32.608913 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 360/742] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:32 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:33.629904 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-bf96f7de-1063-46c5-be54-bc161c397d07 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:33.630440 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-bf96f7de-1063-46c5-be54-bc161c397d07 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:33.636902 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bf96f7de-1063-46c5-be54-bc161c397d07 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:33.637386 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bf96f7de-1063-46c5-be54-bc161c397d07 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:33.637848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bf96f7de-1063-46c5-be54-bc161c397d07 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:33.638576 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bf96f7de-1063-46c5-be54-bc161c397d07 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:33.639063 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bf96f7de-1063-46c5-be54-bc161c397d07 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:33.639581 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bf96f7de-1063-46c5-be54-bc161c397d07 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:33.771165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-bf96f7de-1063-46c5-be54-bc161c397d07 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:33.778472 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-bf96f7de-1063-46c5-be54-bc161c397d07 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.152554 Aug 09 18:23:33.779537 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 383/743] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:33 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:34.800416 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-3a3f8aeb-cb9f-478e-95bc-21e7c458017e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:34.801115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-3a3f8aeb-cb9f-478e-95bc-21e7c458017e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:34.807937 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3a3f8aeb-cb9f-478e-95bc-21e7c458017e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:34.808416 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3a3f8aeb-cb9f-478e-95bc-21e7c458017e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:34.808850 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3a3f8aeb-cb9f-478e-95bc-21e7c458017e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:34.809539 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3a3f8aeb-cb9f-478e-95bc-21e7c458017e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:34.809989 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3a3f8aeb-cb9f-478e-95bc-21e7c458017e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:34.810534 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3a3f8aeb-cb9f-478e-95bc-21e7c458017e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:34.942431 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-3a3f8aeb-cb9f-478e-95bc-21e7c458017e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:34.949902 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-3a3f8aeb-cb9f-478e-95bc-21e7c458017e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.153391 Aug 09 18:23:34.950462 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 361/744] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:34 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:35.972185 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-8a9f74f9-12f9-4d18-872d-34442fc4bf70 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:35.972985 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-8a9f74f9-12f9-4d18-872d-34442fc4bf70 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:35.979478 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8a9f74f9-12f9-4d18-872d-34442fc4bf70 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:35.979959 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8a9f74f9-12f9-4d18-872d-34442fc4bf70 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:35.980395 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8a9f74f9-12f9-4d18-872d-34442fc4bf70 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:35.981073 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8a9f74f9-12f9-4d18-872d-34442fc4bf70 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:35.981533 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8a9f74f9-12f9-4d18-872d-34442fc4bf70 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:35.981956 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8a9f74f9-12f9-4d18-872d-34442fc4bf70 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:36.112596 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-8a9f74f9-12f9-4d18-872d-34442fc4bf70 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:36.120044 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-8a9f74f9-12f9-4d18-872d-34442fc4bf70 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.151689 Aug 09 18:23:36.120608 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 384/745] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:35 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:37.142179 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-b478b30b-98f1-4822-b3f7-5344685dcdf6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:37.142764 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-b478b30b-98f1-4822-b3f7-5344685dcdf6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:37.149131 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b478b30b-98f1-4822-b3f7-5344685dcdf6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:37.149603 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b478b30b-98f1-4822-b3f7-5344685dcdf6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:37.150029 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b478b30b-98f1-4822-b3f7-5344685dcdf6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:37.150732 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b478b30b-98f1-4822-b3f7-5344685dcdf6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:37.151176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b478b30b-98f1-4822-b3f7-5344685dcdf6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:37.151592 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b478b30b-98f1-4822-b3f7-5344685dcdf6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:37.367924 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-b478b30b-98f1-4822-b3f7-5344685dcdf6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:37.376838 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-b478b30b-98f1-4822-b3f7-5344685dcdf6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.239268 Aug 09 18:23:37.385401 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 362/746] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:37 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:38.399457 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d0b0dd28-4725-46c8-8828-81d9dc48c128 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:38.400065 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d0b0dd28-4725-46c8-8828-81d9dc48c128 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:38.406832 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d0b0dd28-4725-46c8-8828-81d9dc48c128 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:38.407317 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d0b0dd28-4725-46c8-8828-81d9dc48c128 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:38.407758 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d0b0dd28-4725-46c8-8828-81d9dc48c128 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:38.408451 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d0b0dd28-4725-46c8-8828-81d9dc48c128 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:38.408907 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d0b0dd28-4725-46c8-8828-81d9dc48c128 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:38.409327 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d0b0dd28-4725-46c8-8828-81d9dc48c128 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:38.539965 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d0b0dd28-4725-46c8-8828-81d9dc48c128 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:38.548024 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d0b0dd28-4725-46c8-8828-81d9dc48c128 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.152376 Aug 09 18:23:38.548587 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 385/747] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:38 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:39.569431 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e36aa520-be26-4a41-8fc0-f85d04049a04 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:39.570078 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e36aa520-be26-4a41-8fc0-f85d04049a04 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:39.577065 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e36aa520-be26-4a41-8fc0-f85d04049a04 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:39.577552 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e36aa520-be26-4a41-8fc0-f85d04049a04 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:39.577981 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e36aa520-be26-4a41-8fc0-f85d04049a04 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:39.578670 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e36aa520-be26-4a41-8fc0-f85d04049a04 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:39.579146 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e36aa520-be26-4a41-8fc0-f85d04049a04 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:39.579571 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e36aa520-be26-4a41-8fc0-f85d04049a04 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:39.713152 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e36aa520-be26-4a41-8fc0-f85d04049a04 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:39.721012 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e36aa520-be26-4a41-8fc0-f85d04049a04 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.155489 Aug 09 18:23:39.721580 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 363/748] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:39 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:40.742423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d0c5a3f8-7dac-4ffe-8742-d0c2483b2e24 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:40.743068 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d0c5a3f8-7dac-4ffe-8742-d0c2483b2e24 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:40.749539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d0c5a3f8-7dac-4ffe-8742-d0c2483b2e24 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:40.750055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d0c5a3f8-7dac-4ffe-8742-d0c2483b2e24 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:40.750495 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d0c5a3f8-7dac-4ffe-8742-d0c2483b2e24 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:40.751215 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d0c5a3f8-7dac-4ffe-8742-d0c2483b2e24 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:40.751673 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d0c5a3f8-7dac-4ffe-8742-d0c2483b2e24 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:40.752100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d0c5a3f8-7dac-4ffe-8742-d0c2483b2e24 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:40.754759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:23:40.885545 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d0c5a3f8-7dac-4ffe-8742-d0c2483b2e24 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:40.893507 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d0c5a3f8-7dac-4ffe-8742-d0c2483b2e24 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1571 microversion: 2.1 time: 0.154887 Aug 09 18:23:40.894081 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 386/749] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:40 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:40.914822 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-b75e7c22-fafb-4b4c-807b-3c4bb9c8b2b9 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:23:40.915420 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-b75e7c22-fafb-4b4c-807b-3c4bb9c8b2b9 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:40.917670 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=46 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:23:40.922754 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b75e7c22-fafb-4b4c-807b-3c4bb9c8b2b9 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:40.923228 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b75e7c22-fafb-4b4c-807b-3c4bb9c8b2b9 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:40.923665 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b75e7c22-fafb-4b4c-807b-3c4bb9c8b2b9 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:40.924355 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b75e7c22-fafb-4b4c-807b-3c4bb9c8b2b9 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:40.924808 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b75e7c22-fafb-4b4c-807b-3c4bb9c8b2b9 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:40.925227 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b75e7c22-fafb-4b4c-807b-3c4bb9c8b2b9 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:40.969162 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-b75e7c22-fafb-4b4c-807b-3c4bb9c8b2b9 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118314) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 18:23:41.235217 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-b75e7c22-fafb-4b4c-807b-3c4bb9c8b2b9 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "POST /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0/action" status: 202 len: 0 microversion: 2.1 time: 0.323850 Aug 09 18:23:41.235820 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 364/750] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Aug 9 18:23:40 2022] POST /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:23:41.244037 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2d005785-601c-4362-ad08-f9fad36e0006 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:41.244750 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-2d005785-601c-4362-ad08-f9fad36e0006 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:41.251883 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2d005785-601c-4362-ad08-f9fad36e0006 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:41.252372 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2d005785-601c-4362-ad08-f9fad36e0006 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:41.252831 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2d005785-601c-4362-ad08-f9fad36e0006 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:41.253520 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2d005785-601c-4362-ad08-f9fad36e0006 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:41.254097 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2d005785-601c-4362-ad08-f9fad36e0006 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:41.254516 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2d005785-601c-4362-ad08-f9fad36e0006 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:41.390021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-2d005785-601c-4362-ad08-f9fad36e0006 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:41.403973 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-2d005785-601c-4362-ad08-f9fad36e0006 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1519 microversion: 2.1 time: 0.163876 Aug 09 18:23:41.404900 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 387/751] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:41 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:42.426902 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-6ee62a1a-91eb-4ce7-940f-09d009a5772e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:42.427663 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-6ee62a1a-91eb-4ce7-940f-09d009a5772e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:42.433811 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6ee62a1a-91eb-4ce7-940f-09d009a5772e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:42.434631 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6ee62a1a-91eb-4ce7-940f-09d009a5772e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:42.435336 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6ee62a1a-91eb-4ce7-940f-09d009a5772e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:42.436861 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6ee62a1a-91eb-4ce7-940f-09d009a5772e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:42.437550 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6ee62a1a-91eb-4ce7-940f-09d009a5772e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:42.438042 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6ee62a1a-91eb-4ce7-940f-09d009a5772e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:42.508832 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-7ff3d1cd-7f38-446c-ace0-491ec4bc49d8 req-9b684248-f4a4-45d0-b61f-1a95c1e56755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4979ac5e-c9e0-4028-8bfe-e928f34a6bf0", "name": "network-vif-unplugged", "status": "completed", "tag": "8911ba4a-f945-4b8b-9d28-626b00b2addb"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:23:42.530252 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-7ff3d1cd-7f38-446c-ace0-491ec4bc49d8 req-9b684248-f4a4-45d0-b61f-1a95c1e56755 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:42.530252 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-7ff3d1cd-7f38-446c-ace0-491ec4bc49d8 req-9b684248-f4a4-45d0-b61f-1a95c1e56755 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:42.530252 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-7ff3d1cd-7f38-446c-ace0-491ec4bc49d8 req-9b684248-f4a4-45d0-b61f-1a95c1e56755 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:42.537002 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.compute.server_external_events [req-7ff3d1cd-7f38-446c-ace0-491ec4bc49d8 req-9b684248-f4a4-45d0-b61f-1a95c1e56755 service nova] Unable to find a host for instance 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0. Dropping event network-vif-unplugged {{(pid=118313) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 18:23:42.537984 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-7ff3d1cd-7f38-446c-ace0-491ec4bc49d8 req-9b684248-f4a4-45d0-b61f-1a95c1e56755 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033788 Aug 09 18:23:42.538656 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 388/752] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 09 18:23:42.577961 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-6ee62a1a-91eb-4ce7-940f-09d009a5772e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:42.587408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-6ee62a1a-91eb-4ce7-940f-09d009a5772e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1519 microversion: 2.1 time: 0.163801 Aug 09 18:23:42.587408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 365/753] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:42 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:23:43.607482 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9d8748a5-a00b-4a7d-bddd-d82f9816fc40 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:43.608245 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9d8748a5-a00b-4a7d-bddd-d82f9816fc40 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:43.614724 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9d8748a5-a00b-4a7d-bddd-d82f9816fc40 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:43.615214 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9d8748a5-a00b-4a7d-bddd-d82f9816fc40 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:43.615640 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9d8748a5-a00b-4a7d-bddd-d82f9816fc40 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:43.616359 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9d8748a5-a00b-4a7d-bddd-d82f9816fc40 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:43.616807 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9d8748a5-a00b-4a7d-bddd-d82f9816fc40 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:43.617225 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9d8748a5-a00b-4a7d-bddd-d82f9816fc40 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:43.750854 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9d8748a5-a00b-4a7d-bddd-d82f9816fc40 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:43.758367 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9d8748a5-a00b-4a7d-bddd-d82f9816fc40 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1521 microversion: 2.1 time: 0.154597 Aug 09 18:23:43.758903 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 389/754] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:43 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:44.781132 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-1bb0a2ee-b471-41fe-a8fc-205c9d1ac753 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:44.781750 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-1bb0a2ee-b471-41fe-a8fc-205c9d1ac753 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:44.788108 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1bb0a2ee-b471-41fe-a8fc-205c9d1ac753 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:44.788590 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1bb0a2ee-b471-41fe-a8fc-205c9d1ac753 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:44.789024 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1bb0a2ee-b471-41fe-a8fc-205c9d1ac753 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:44.789717 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1bb0a2ee-b471-41fe-a8fc-205c9d1ac753 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:44.790172 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1bb0a2ee-b471-41fe-a8fc-205c9d1ac753 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:44.790655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1bb0a2ee-b471-41fe-a8fc-205c9d1ac753 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:44.922490 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-1bb0a2ee-b471-41fe-a8fc-205c9d1ac753 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:44.929908 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-1bb0a2ee-b471-41fe-a8fc-205c9d1ac753 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1577 microversion: 2.1 time: 0.153309 Aug 09 18:23:44.930464 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 366/755] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:44 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:45.443540 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-8bcea71f-497a-450d-9dc4-4e060152f71d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:45.444045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-8bcea71f-497a-450d-9dc4-4e060152f71d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:45.450530 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8bcea71f-497a-450d-9dc4-4e060152f71d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:45.451037 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8bcea71f-497a-450d-9dc4-4e060152f71d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:45.451635 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8bcea71f-497a-450d-9dc4-4e060152f71d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:45.452322 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8bcea71f-497a-450d-9dc4-4e060152f71d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:45.452773 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8bcea71f-497a-450d-9dc4-4e060152f71d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:45.453236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8bcea71f-497a-450d-9dc4-4e060152f71d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:45.534670 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.objects.instance [None req-8bcea71f-497a-450d-9dc4-4e060152f71d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lazy-loading 'services' on Instance uuid 245f64c6-0159-4c0d-816e-8cd5213fd655 {{(pid=118313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:23:45.792128 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-8bcea71f-497a-450d-9dc4-4e060152f71d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "DELETE /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655/os-volume_attachments/592eb6ec-81ff-43f0-8498-244b5aaa5422" status: 202 len: 0 microversion: 2.1 time: 0.352251 Aug 09 18:23:45.792710 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 390/756] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Aug 9 18:23:45 2022] DELETE /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655/os-volume_attachments/592eb6ec-81ff-43f0-8498-244b5aaa5422 => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:23:45.801919 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-dcdace70-e403-415c-9479-7d53d827f90a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:45.804199 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-dcdace70-e403-415c-9479-7d53d827f90a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:45.810634 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dcdace70-e403-415c-9479-7d53d827f90a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:45.811160 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dcdace70-e403-415c-9479-7d53d827f90a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:45.811594 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dcdace70-e403-415c-9479-7d53d827f90a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:45.812275 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dcdace70-e403-415c-9479-7d53d827f90a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:45.812725 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dcdace70-e403-415c-9479-7d53d827f90a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:45.813146 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dcdace70-e403-415c-9479-7d53d827f90a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:45.844181 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-dcdace70-e403-415c-9479-7d53d827f90a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046220 Aug 09 18:23:45.844777 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 367/757] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Aug 9 18:23:45 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:23:45.952541 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-4c9ab221-13c7-47dc-95bd-fc26100cf426 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:45.953150 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-4c9ab221-13c7-47dc-95bd-fc26100cf426 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:45.963642 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4c9ab221-13c7-47dc-95bd-fc26100cf426 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:45.963642 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4c9ab221-13c7-47dc-95bd-fc26100cf426 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:45.963642 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4c9ab221-13c7-47dc-95bd-fc26100cf426 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:45.963642 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4c9ab221-13c7-47dc-95bd-fc26100cf426 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:45.963928 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4c9ab221-13c7-47dc-95bd-fc26100cf426 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:45.963928 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4c9ab221-13c7-47dc-95bd-fc26100cf426 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:46.096400 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4c9ab221-13c7-47dc-95bd-fc26100cf426 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:46.104019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-4c9ab221-13c7-47dc-95bd-fc26100cf426 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1577 microversion: 2.1 time: 0.156307 Aug 09 18:23:46.104588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 391/758] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:45 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:46.864890 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-5017c5e9-e6bb-49d7-905e-7a58ac75c636 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:46.868166 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-5017c5e9-e6bb-49d7-905e-7a58ac75c636 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:46.876161 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5017c5e9-e6bb-49d7-905e-7a58ac75c636 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:46.876630 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5017c5e9-e6bb-49d7-905e-7a58ac75c636 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:46.877064 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5017c5e9-e6bb-49d7-905e-7a58ac75c636 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:46.877755 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5017c5e9-e6bb-49d7-905e-7a58ac75c636 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:46.878209 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5017c5e9-e6bb-49d7-905e-7a58ac75c636 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:46.878662 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5017c5e9-e6bb-49d7-905e-7a58ac75c636 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:46.907182 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-5017c5e9-e6bb-49d7-905e-7a58ac75c636 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046306 Aug 09 18:23:46.907939 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 368/759] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Aug 9 18:23:46 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:23:47.124993 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f8d5c8d1-a9d8-4fe3-8074-b87ace4e59c7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:47.125827 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f8d5c8d1-a9d8-4fe3-8074-b87ace4e59c7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:47.132678 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8d5c8d1-a9d8-4fe3-8074-b87ace4e59c7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:47.133158 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8d5c8d1-a9d8-4fe3-8074-b87ace4e59c7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:47.133589 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8d5c8d1-a9d8-4fe3-8074-b87ace4e59c7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:47.134270 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8d5c8d1-a9d8-4fe3-8074-b87ace4e59c7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:47.134740 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8d5c8d1-a9d8-4fe3-8074-b87ace4e59c7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:47.135162 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f8d5c8d1-a9d8-4fe3-8074-b87ace4e59c7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:47.263395 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f8d5c8d1-a9d8-4fe3-8074-b87ace4e59c7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:47.271187 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f8d5c8d1-a9d8-4fe3-8074-b87ace4e59c7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1577 microversion: 2.1 time: 0.150080 Aug 09 18:23:47.271781 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 392/760] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:47 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:47.919640 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8b12e18a-72bd-48cf-b1e2-e68e5d23b3d1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:47.922520 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8b12e18a-72bd-48cf-b1e2-e68e5d23b3d1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:47.928969 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8b12e18a-72bd-48cf-b1e2-e68e5d23b3d1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:47.929450 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8b12e18a-72bd-48cf-b1e2-e68e5d23b3d1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:47.929887 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8b12e18a-72bd-48cf-b1e2-e68e5d23b3d1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:47.930569 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8b12e18a-72bd-48cf-b1e2-e68e5d23b3d1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:47.931055 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8b12e18a-72bd-48cf-b1e2-e68e5d23b3d1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:47.931476 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8b12e18a-72bd-48cf-b1e2-e68e5d23b3d1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:47.959686 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8b12e18a-72bd-48cf-b1e2-e68e5d23b3d1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043941 Aug 09 18:23:47.960237 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 369/761] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Aug 9 18:23:47 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 18:23:48.038209 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-fc8efa98-bd60-4dcf-9a84-17d1b6a38023 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:48.038699 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-fc8efa98-bd60-4dcf-9a84-17d1b6a38023 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:48.044572 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fc8efa98-bd60-4dcf-9a84-17d1b6a38023 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:48.045703 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fc8efa98-bd60-4dcf-9a84-17d1b6a38023 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:48.046301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fc8efa98-bd60-4dcf-9a84-17d1b6a38023 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:48.047037 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fc8efa98-bd60-4dcf-9a84-17d1b6a38023 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:48.047496 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fc8efa98-bd60-4dcf-9a84-17d1b6a38023 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:48.047918 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fc8efa98-bd60-4dcf-9a84-17d1b6a38023 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:48.072000 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-fc8efa98-bd60-4dcf-9a84-17d1b6a38023 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Going to try to terminate instance {{(pid=118313) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:23:48.292979 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-2324ae3b-3671-47d6-9261-82d1627fa5d2 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:48.293588 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-2324ae3b-3671-47d6-9261-82d1627fa5d2 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:48.299874 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2324ae3b-3671-47d6-9261-82d1627fa5d2 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:48.300681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2324ae3b-3671-47d6-9261-82d1627fa5d2 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:48.301008 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2324ae3b-3671-47d6-9261-82d1627fa5d2 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:48.301706 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2324ae3b-3671-47d6-9261-82d1627fa5d2 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:48.302168 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2324ae3b-3671-47d6-9261-82d1627fa5d2 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:48.302594 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2324ae3b-3671-47d6-9261-82d1627fa5d2 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:48.376510 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-fc8efa98-bd60-4dcf-9a84-17d1b6a38023 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "DELETE /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 204 len: 0 microversion: 2.1 time: 0.341780 Aug 09 18:23:48.377105 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 393/762] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:23:48 2022] DELETE /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:23:48.385474 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a65fd28b-f165-4f97-9151-638c8f219042 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:48.386162 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a65fd28b-f165-4f97-9151-638c8f219042 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:48.392971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a65fd28b-f165-4f97-9151-638c8f219042 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:48.393457 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a65fd28b-f165-4f97-9151-638c8f219042 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:48.393887 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a65fd28b-f165-4f97-9151-638c8f219042 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:48.394604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a65fd28b-f165-4f97-9151-638c8f219042 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:48.395203 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a65fd28b-f165-4f97-9151-638c8f219042 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:48.395626 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a65fd28b-f165-4f97-9151-638c8f219042 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:48.695489 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-2324ae3b-3671-47d6-9261-82d1627fa5d2 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:48.703288 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-2324ae3b-3671-47d6-9261-82d1627fa5d2 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1577 microversion: 2.1 time: 0.414174 Aug 09 18:23:48.703874 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 370/763] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:48 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1577 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:23:48.739866 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a65fd28b-f165-4f97-9151-638c8f219042 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:48.747330 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a65fd28b-f165-4f97-9151-638c8f219042 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1689 microversion: 2.1 time: 0.366092 Aug 09 18:23:48.747890 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 394/764] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:48 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1689 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:23:49.725217 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c5375f77-de0a-46bc-8430-5b3398cb03d3 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:49.725754 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c5375f77-de0a-46bc-8430-5b3398cb03d3 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:49.732168 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5375f77-de0a-46bc-8430-5b3398cb03d3 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:49.732661 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5375f77-de0a-46bc-8430-5b3398cb03d3 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:49.733091 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5375f77-de0a-46bc-8430-5b3398cb03d3 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:49.733773 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5375f77-de0a-46bc-8430-5b3398cb03d3 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:49.734225 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5375f77-de0a-46bc-8430-5b3398cb03d3 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:49.734933 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5375f77-de0a-46bc-8430-5b3398cb03d3 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:49.768670 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e63dd929-8e8c-4a11-8abb-bcbfdcadc471 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:49.769394 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e63dd929-8e8c-4a11-8abb-bcbfdcadc471 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:49.775798 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e63dd929-8e8c-4a11-8abb-bcbfdcadc471 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:49.776285 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e63dd929-8e8c-4a11-8abb-bcbfdcadc471 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:49.776723 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e63dd929-8e8c-4a11-8abb-bcbfdcadc471 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:49.777450 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e63dd929-8e8c-4a11-8abb-bcbfdcadc471 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:49.777894 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e63dd929-8e8c-4a11-8abb-bcbfdcadc471 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:49.778799 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e63dd929-8e8c-4a11-8abb-bcbfdcadc471 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:49.921495 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c5375f77-de0a-46bc-8430-5b3398cb03d3 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:49.928992 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c5375f77-de0a-46bc-8430-5b3398cb03d3 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1577 microversion: 2.1 time: 0.207917 Aug 09 18:23:49.929797 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 371/765] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:49 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1577 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:49.944727 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e63dd929-8e8c-4a11-8abb-bcbfdcadc471 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:49.952958 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e63dd929-8e8c-4a11-8abb-bcbfdcadc471 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1689 microversion: 2.1 time: 0.188064 Aug 09 18:23:49.953522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 395/766] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:49 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1689 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:50.952549 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-5f0502e4-452d-4956-8eb8-0f558bc90408 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:50.953377 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-5f0502e4-452d-4956-8eb8-0f558bc90408 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:50.961317 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5f0502e4-452d-4956-8eb8-0f558bc90408 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:50.961933 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5f0502e4-452d-4956-8eb8-0f558bc90408 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:50.962665 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5f0502e4-452d-4956-8eb8-0f558bc90408 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:50.963511 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5f0502e4-452d-4956-8eb8-0f558bc90408 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:50.964000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5f0502e4-452d-4956-8eb8-0f558bc90408 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:50.964422 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5f0502e4-452d-4956-8eb8-0f558bc90408 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:50.974523 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-4e94ccbb-5cd7-437c-baa2-3eff0f0ab435 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:50.975169 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-4e94ccbb-5cd7-437c-baa2-3eff0f0ab435 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:50.980954 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4e94ccbb-5cd7-437c-baa2-3eff0f0ab435 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:50.981428 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4e94ccbb-5cd7-437c-baa2-3eff0f0ab435 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:50.981894 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4e94ccbb-5cd7-437c-baa2-3eff0f0ab435 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:50.983225 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4e94ccbb-5cd7-437c-baa2-3eff0f0ab435 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:50.983882 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4e94ccbb-5cd7-437c-baa2-3eff0f0ab435 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:50.984318 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4e94ccbb-5cd7-437c-baa2-3eff0f0ab435 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:51.167062 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-5f0502e4-452d-4956-8eb8-0f558bc90408 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:51.174601 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4e94ccbb-5cd7-437c-baa2-3eff0f0ab435 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:51.174871 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-5f0502e4-452d-4956-8eb8-0f558bc90408 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1577 microversion: 2.1 time: 0.226916 Aug 09 18:23:51.175331 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 372/767] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:50 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1577 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:51.183081 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-4e94ccbb-5cd7-437c-baa2-3eff0f0ab435 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1689 microversion: 2.1 time: 0.212839 Aug 09 18:23:51.183647 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 396/768] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:50 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1689 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:52.196404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-0c2304f5-7178-4c3d-9e36-1a75985b5502 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:52.197162 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-0c2304f5-7178-4c3d-9e36-1a75985b5502 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:52.203418 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0c2304f5-7178-4c3d-9e36-1a75985b5502 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:52.203890 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-1f5c9ba5-8540-40e6-b30a-0c193aa015c9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:52.204364 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0c2304f5-7178-4c3d-9e36-1a75985b5502 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:52.204364 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0c2304f5-7178-4c3d-9e36-1a75985b5502 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:52.204687 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-1f5c9ba5-8540-40e6-b30a-0c193aa015c9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:52.205138 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0c2304f5-7178-4c3d-9e36-1a75985b5502 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:52.205475 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0c2304f5-7178-4c3d-9e36-1a75985b5502 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:52.205893 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0c2304f5-7178-4c3d-9e36-1a75985b5502 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:52.210732 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1f5c9ba5-8540-40e6-b30a-0c193aa015c9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:52.211226 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1f5c9ba5-8540-40e6-b30a-0c193aa015c9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:52.211653 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1f5c9ba5-8540-40e6-b30a-0c193aa015c9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:52.212350 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1f5c9ba5-8540-40e6-b30a-0c193aa015c9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:52.212806 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1f5c9ba5-8540-40e6-b30a-0c193aa015c9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:52.213229 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1f5c9ba5-8540-40e6-b30a-0c193aa015c9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:52.403505 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-0c2304f5-7178-4c3d-9e36-1a75985b5502 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:52.411176 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-1f5c9ba5-8540-40e6-b30a-0c193aa015c9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:52.411574 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-0c2304f5-7178-4c3d-9e36-1a75985b5502 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1577 microversion: 2.1 time: 0.218966 Aug 09 18:23:52.412145 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 373/769] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:52 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1577 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:52.418669 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-1f5c9ba5-8540-40e6-b30a-0c193aa015c9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1689 microversion: 2.1 time: 0.218763 Aug 09 18:23:52.419240 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 397/770] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:52 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1689 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:23:53.433728 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c0550578-4389-4278-996a-283728cb5c4f tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:53.434998 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c0550578-4389-4278-996a-283728cb5c4f tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:53.440941 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-95cef31d-5cc6-4920-8eb8-fe5d64f56593 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:53.445496 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-95cef31d-5cc6-4920-8eb8-fe5d64f56593 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:53.445643 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c0550578-4389-4278-996a-283728cb5c4f tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:53.445643 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c0550578-4389-4278-996a-283728cb5c4f tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:53.445643 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c0550578-4389-4278-996a-283728cb5c4f tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:53.445643 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c0550578-4389-4278-996a-283728cb5c4f tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:53.445974 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c0550578-4389-4278-996a-283728cb5c4f tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:53.445974 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c0550578-4389-4278-996a-283728cb5c4f tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:53.448053 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-95cef31d-5cc6-4920-8eb8-fe5d64f56593 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:53.448537 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-95cef31d-5cc6-4920-8eb8-fe5d64f56593 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:53.449108 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-95cef31d-5cc6-4920-8eb8-fe5d64f56593 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:53.449816 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-95cef31d-5cc6-4920-8eb8-fe5d64f56593 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:53.450270 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-95cef31d-5cc6-4920-8eb8-fe5d64f56593 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:53.450695 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-95cef31d-5cc6-4920-8eb8-fe5d64f56593 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:53.695003 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c0550578-4389-4278-996a-283728cb5c4f tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:53.703115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c0550578-4389-4278-996a-283728cb5c4f tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1577 microversion: 2.1 time: 0.273433 Aug 09 18:23:53.709371 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 374/771] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:53 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1577 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:53.710454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-95cef31d-5cc6-4920-8eb8-fe5d64f56593 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:53.718078 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-95cef31d-5cc6-4920-8eb8-fe5d64f56593 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1689 microversion: 2.1 time: 0.281778 Aug 09 18:23:53.718650 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 398/772] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:53 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1689 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:54.030589 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-48092419-8c69-411e-9ef7-8ec6515fc742 req-65689841-6459-403a-b482-5c7a1886302e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "245f64c6-0159-4c0d-816e-8cd5213fd655", "name": "network-vif-deleted", "tag": "35a445c4-7451-48bc-a24d-97a7becfc3de"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:23:54.039768 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-48092419-8c69-411e-9ef7-8ec6515fc742 req-65689841-6459-403a-b482-5c7a1886302e service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:54.040239 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-48092419-8c69-411e-9ef7-8ec6515fc742 req-65689841-6459-403a-b482-5c7a1886302e service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:54.040660 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-48092419-8c69-411e-9ef7-8ec6515fc742 req-65689841-6459-403a-b482-5c7a1886302e service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:54.052165 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-48092419-8c69-411e-9ef7-8ec6515fc742 req-65689841-6459-403a-b482-5c7a1886302e service nova] Creating event network-vif-deleted:35a445c4-7451-48bc-a24d-97a7becfc3de for instance 245f64c6-0159-4c0d-816e-8cd5213fd655 on hv-cinder-79797 Aug 09 18:23:54.057443 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-48092419-8c69-411e-9ef7-8ec6515fc742 req-65689841-6459-403a-b482-5c7a1886302e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030678 Aug 09 18:23:54.058296 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 375/773] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:23:54.723958 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-ff62a247-385e-4882-84cf-1f7479bb10a6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:54.724740 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-ff62a247-385e-4882-84cf-1f7479bb10a6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:54.727133 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:23:54.731798 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ff62a247-385e-4882-84cf-1f7479bb10a6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:54.732319 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ff62a247-385e-4882-84cf-1f7479bb10a6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:54.734410 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ff62a247-385e-4882-84cf-1f7479bb10a6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:54.734410 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ff62a247-385e-4882-84cf-1f7479bb10a6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:54.734410 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ff62a247-385e-4882-84cf-1f7479bb10a6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:54.734410 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ff62a247-385e-4882-84cf-1f7479bb10a6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:54.741086 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8237b97b-4958-4eca-9580-44e1615ae3e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:54.752357 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8237b97b-4958-4eca-9580-44e1615ae3e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:54.752357 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8237b97b-4958-4eca-9580-44e1615ae3e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:54.752357 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8237b97b-4958-4eca-9580-44e1615ae3e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:54.752357 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8237b97b-4958-4eca-9580-44e1615ae3e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:54.752836 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8237b97b-4958-4eca-9580-44e1615ae3e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:54.752836 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8237b97b-4958-4eca-9580-44e1615ae3e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:54.753237 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8237b97b-4958-4eca-9580-44e1615ae3e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:54.789838 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8237b97b-4958-4eca-9580-44e1615ae3e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:54.790320 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8237b97b-4958-4eca-9580-44e1615ae3e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:54.790942 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8237b97b-4958-4eca-9580-44e1615ae3e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:54.791554 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.objects.instance [None req-8237b97b-4958-4eca-9580-44e1615ae3e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lazy-loading 'fault' on Instance uuid 245f64c6-0159-4c0d-816e-8cd5213fd655 {{(pid=118314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:23:54.862178 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8237b97b-4958-4eca-9580-44e1615ae3e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:54.865786 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:23:54.870360 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8237b97b-4958-4eca-9580-44e1615ae3e1 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 200 len: 1334 microversion: 2.1 time: 0.134062 Aug 09 18:23:54.872680 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 376/774] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:54 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 1334 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:54.920718 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ff62a247-385e-4882-84cf-1f7479bb10a6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:54.928618 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-ff62a247-385e-4882-84cf-1f7479bb10a6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1577 microversion: 2.1 time: 0.208416 Aug 09 18:23:54.929952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 399/775] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:54 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1577 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:23:55.895844 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-63e3560a-a1f5-4f59-8110-9427d778d4ce tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:55.896466 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-63e3560a-a1f5-4f59-8110-9427d778d4ce tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 245f64c6-0159-4c0d-816e-8cd5213fd655] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:55.903586 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-63e3560a-a1f5-4f59-8110-9427d778d4ce tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:55.904070 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-63e3560a-a1f5-4f59-8110-9427d778d4ce tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:55.905072 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-63e3560a-a1f5-4f59-8110-9427d778d4ce tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:55.905864 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-63e3560a-a1f5-4f59-8110-9427d778d4ce tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:55.906323 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-63e3560a-a1f5-4f59-8110-9427d778d4ce tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:55.906772 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-63e3560a-a1f5-4f59-8110-9427d778d4ce tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:55.920777 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-63e3560a-a1f5-4f59-8110-9427d778d4ce tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] HTTP exception thrown: Instance 245f64c6-0159-4c0d-816e-8cd5213fd655 could not be found. Aug 09 18:23:55.922408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-63e3560a-a1f5-4f59-8110-9427d778d4ce tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Request method failure captured: Aug 09 18:23:55.922408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 HTTP/1.1 Aug 09 18:23:55.922408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:23:55.922408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:23:55.922408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:23:55.922408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 0 Aug 09 18:23:55.922408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:23:55.922408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:23:55.922408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:23:55.922408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:23:55.922408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qRIOR_EAMdUNpksmgwcf99FOSSqhVI8tsoIxh3BjiMzTfrXpYksm4wl0XX75hcX4zSB7VEWBHIFqhlPU6iolaNft99hftdwd5BJh27Wa4fHll0E3coSOe8qDBsNwpnORq82KDHpkxKtU9qWPAuGjeYDz1tW8ACtpXpu2MbvQ0yJQ-Q Aug 09 18:23:55.922408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:23:55.922408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:23:55.922408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:23:55.922408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:23:55.922408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:23:55.922408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:23:55.922408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: dbd7e50444cc4ef0873bfac9d9a2d514 Aug 09 18:23:55.922408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-460293175 Aug 09 18:23:55.922408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:23:55.922408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:23:55.924114 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dbd7e50444cc4ef0873bfac9d9a2d514"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dbd7e50444cc4ef0873bfac9d9a2d514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dbd7e50444cc4ef0873bfac9d9a2d514", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dbd7e50444cc4ef0873bfac9d9a2d514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:23:55.924114 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-ServerRescueNegativeTestJSON-460293175 Aug 09 18:23:55.924114 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: dbd7e50444cc4ef0873bfac9d9a2d514 Aug 09 18:23:55.924114 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-460293175 Aug 09 18:23:55.924114 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-ServerRescueNegativeTestJSON-460293175-project Aug 09 18:23:55.924114 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:23:55.924114 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:23:55.924114 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: 18fae6990e4148ff97dec28b204c52df Aug 09 18:23:55.924114 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-ServerRescueNegativeTestJSON-460293175-project Aug 09 18:23:55.924114 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: > Aug 09 18:23:55.924114 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Instance 245f64c6-0159-4c0d-816e-8cd5213fd655 could not be found. Aug 09 18:23:55.924114 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'id': '245f64c6-0159-4c0d-816e-8cd5213fd655'} Aug 09 18:23:55.925011 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:23:55.925011 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:23:55.925011 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:23:55.925011 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:23:55.925011 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:23:55.925011 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:23:55.925011 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:23:55.925011 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:23:55.925011 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:23:55.925011 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:23:55.925011 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 245f64c6-0159-4c0d-816e-8cd5213fd655 could not be found. Aug 09 18:23:55.925011 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:23:55.925011 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:23:55.925011 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:23:55.925011 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:23:55.925011 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:23:55.925011 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:23:55.925011 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:23:55.925011 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:23:55.925011 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:23:55.926504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:23:55.926504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:23:55.926504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:23:55.926504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:23:55.926504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:23:55.926504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:23:55.926504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:23:55.926504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 245f64c6-0159-4c0d-816e-8cd5213fd655 could not be found. Aug 09 18:23:55.926504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:23:55.926504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:23:55.926504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:23:55.926504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:23:55.926504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:23:55.926504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:23:55.926504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:23:55.926504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:23:55.926504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 245f64c6-0159-4c0d-816e-8cd5213fd655 could not be found. Aug 09 18:23:55.926504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:23:55.927862 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-63e3560a-a1f5-4f59-8110-9427d778d4ce tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Returning 404 to user: Instance 245f64c6-0159-4c0d-816e-8cd5213fd655 could not be found. {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:23:55.927862 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-63e3560a-a1f5-4f59-8110-9427d778d4ce tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655" status: 404 len: 111 microversion: 2.1 time: 0.031932 Aug 09 18:23:55.927862 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 377/776] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:55 2022] GET /compute/v2.1/servers/245f64c6-0159-4c0d-816e-8cd5213fd655 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:23:55.932647 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-315306ad-7be5-4a5d-992d-4e27d439ca69 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '.version_select at 0x7f4c351379d0>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:55.950418 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-3c6998e6-9397-4efa-9b2a-2cef57e6c729 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:55.951085 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-3c6998e6-9397-4efa-9b2a-2cef57e6c729 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:55.958419 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3c6998e6-9397-4efa-9b2a-2cef57e6c729 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:55.971064 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3c6998e6-9397-4efa-9b2a-2cef57e6c729 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:55.971064 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3c6998e6-9397-4efa-9b2a-2cef57e6c729 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:55.971064 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3c6998e6-9397-4efa-9b2a-2cef57e6c729 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:55.971064 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3c6998e6-9397-4efa-9b2a-2cef57e6c729 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:55.971450 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3c6998e6-9397-4efa-9b2a-2cef57e6c729 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:56.019548 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-315306ad-7be5-4a5d-992d-4e27d439ca69 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-684107855" status: 202 len: 0 microversion: 2.1 time: 0.090577 Aug 09 18:23:56.020171 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 400/777] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Aug 9 18:23:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-684107855 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:23:56.098277 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-3c6998e6-9397-4efa-9b2a-2cef57e6c729 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:56.105742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-3c6998e6-9397-4efa-9b2a-2cef57e6c729 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1577 microversion: 2.1 time: 0.159079 Aug 09 18:23:56.106311 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 378/778] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:55 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:23:56.650333 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-8cff3ecd-97ff-477a-8d9a-0be454d08504 req-72800d3c-a3ca-460a-bd92-ddeda2d4196b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4979ac5e-c9e0-4028-8bfe-e928f34a6bf0", "name": "network-vif-plugged", "status": "completed", "tag": "8911ba4a-f945-4b8b-9d28-626b00b2addb"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:23:56.820351 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-8cff3ecd-97ff-477a-8d9a-0be454d08504 req-72800d3c-a3ca-460a-bd92-ddeda2d4196b service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:56.821048 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-8cff3ecd-97ff-477a-8d9a-0be454d08504 req-72800d3c-a3ca-460a-bd92-ddeda2d4196b service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:56.821492 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-8cff3ecd-97ff-477a-8d9a-0be454d08504 req-72800d3c-a3ca-460a-bd92-ddeda2d4196b service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:56.832772 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-8cff3ecd-97ff-477a-8d9a-0be454d08504 req-72800d3c-a3ca-460a-bd92-ddeda2d4196b service nova] Creating event network-vif-plugged:8911ba4a-f945-4b8b-9d28-626b00b2addb for instance 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 on hv-cinder-79797 Aug 09 18:23:56.838072 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-8cff3ecd-97ff-477a-8d9a-0be454d08504 req-72800d3c-a3ca-460a-bd92-ddeda2d4196b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191386 Aug 09 18:23:56.838815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 401/779] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:23:57.127759 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-373826dc-b7c6-44af-91ea-a93585afd381 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:57.128511 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-373826dc-b7c6-44af-91ea-a93585afd381 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:57.135050 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-373826dc-b7c6-44af-91ea-a93585afd381 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:57.135533 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-373826dc-b7c6-44af-91ea-a93585afd381 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:57.135964 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-373826dc-b7c6-44af-91ea-a93585afd381 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:57.136647 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-373826dc-b7c6-44af-91ea-a93585afd381 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:57.137095 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-373826dc-b7c6-44af-91ea-a93585afd381 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:57.137512 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-373826dc-b7c6-44af-91ea-a93585afd381 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:57.314672 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-373826dc-b7c6-44af-91ea-a93585afd381 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:57.323804 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-373826dc-b7c6-44af-91ea-a93585afd381 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1577 microversion: 2.1 time: 0.199946 Aug 09 18:23:57.324358 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 379/780] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:57 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1577 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:57.601286 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:23:57.601764 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Tue Aug 9 18:23:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:23:58.347844 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9eb55fbb-f14c-4a7b-b6f3-4ba91eab99a7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:58.348454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9eb55fbb-f14c-4a7b-b6f3-4ba91eab99a7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:58.354574 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9eb55fbb-f14c-4a7b-b6f3-4ba91eab99a7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:58.356037 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9eb55fbb-f14c-4a7b-b6f3-4ba91eab99a7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:58.356037 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9eb55fbb-f14c-4a7b-b6f3-4ba91eab99a7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:58.356301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9eb55fbb-f14c-4a7b-b6f3-4ba91eab99a7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:58.356751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9eb55fbb-f14c-4a7b-b6f3-4ba91eab99a7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:58.357168 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9eb55fbb-f14c-4a7b-b6f3-4ba91eab99a7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:58.494946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9eb55fbb-f14c-4a7b-b6f3-4ba91eab99a7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:58.497231 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:23:58.503375 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9eb55fbb-f14c-4a7b-b6f3-4ba91eab99a7 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1577 microversion: 2.1 time: 0.160497 Aug 09 18:23:58.503930 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 402/781] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:58 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:23:59.334217 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c4f8b4c8-8f1a-4601-b653-bdabc486f1f9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:59.334695 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c4f8b4c8-8f1a-4601-b653-bdabc486f1f9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:59.341167 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c4f8b4c8-8f1a-4601-b653-bdabc486f1f9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:59.341645 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c4f8b4c8-8f1a-4601-b653-bdabc486f1f9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:59.342083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c4f8b4c8-8f1a-4601-b653-bdabc486f1f9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:59.342810 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c4f8b4c8-8f1a-4601-b653-bdabc486f1f9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:59.343260 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c4f8b4c8-8f1a-4601-b653-bdabc486f1f9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:59.343678 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c4f8b4c8-8f1a-4601-b653-bdabc486f1f9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:59.369108 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c4f8b4c8-8f1a-4601-b653-bdabc486f1f9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Going to try to terminate instance {{(pid=118314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:23:59.525653 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-7eec7b99-22e4-475d-88cd-dbb87f0ba070 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:59.526340 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-7eec7b99-22e4-475d-88cd-dbb87f0ba070 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:59.533459 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7eec7b99-22e4-475d-88cd-dbb87f0ba070 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:59.533946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7eec7b99-22e4-475d-88cd-dbb87f0ba070 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:59.534423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7eec7b99-22e4-475d-88cd-dbb87f0ba070 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:59.535118 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7eec7b99-22e4-475d-88cd-dbb87f0ba070 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:59.535574 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7eec7b99-22e4-475d-88cd-dbb87f0ba070 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:59.538939 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7eec7b99-22e4-475d-88cd-dbb87f0ba070 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:59.672174 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-7eec7b99-22e4-475d-88cd-dbb87f0ba070 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:59.675733 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c4f8b4c8-8f1a-4601-b653-bdabc486f1f9 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "DELETE /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 204 len: 0 microversion: 2.1 time: 0.345033 Aug 09 18:23:59.677514 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 380/782] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:23:59 2022] DELETE /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:23:59.680180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-7eec7b99-22e4-475d-88cd-dbb87f0ba070 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1564 microversion: 2.1 time: 0.158215 Aug 09 18:23:59.680676 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 403/783] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:59 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:23:59.684993 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-cba8a622-79f0-41d0-9663-148a8cce35ca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:23:59.685700 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-cba8a622-79f0-41d0-9663-148a8cce35ca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:23:59.691729 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cba8a622-79f0-41d0-9663-148a8cce35ca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:59.692208 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cba8a622-79f0-41d0-9663-148a8cce35ca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:59.692640 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cba8a622-79f0-41d0-9663-148a8cce35ca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:59.693323 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cba8a622-79f0-41d0-9663-148a8cce35ca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:23:59.693776 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cba8a622-79f0-41d0-9663-148a8cce35ca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:23:59.694200 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-cba8a622-79f0-41d0-9663-148a8cce35ca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:23:59.821901 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-cba8a622-79f0-41d0-9663-148a8cce35ca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:23:59.829541 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-cba8a622-79f0-41d0-9663-148a8cce35ca tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1507 microversion: 2.1 time: 0.148631 Aug 09 18:23:59.830105 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 381/784] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:23:59 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:24:00.851508 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c29cdd3e-ba20-4c86-abf5-dc72e7ffa64d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:00.852104 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-c29cdd3e-ba20-4c86-abf5-dc72e7ffa64d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:00.859678 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c29cdd3e-ba20-4c86-abf5-dc72e7ffa64d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:00.860177 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c29cdd3e-ba20-4c86-abf5-dc72e7ffa64d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:00.860626 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c29cdd3e-ba20-4c86-abf5-dc72e7ffa64d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:00.861333 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c29cdd3e-ba20-4c86-abf5-dc72e7ffa64d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:00.861848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c29cdd3e-ba20-4c86-abf5-dc72e7ffa64d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:00.862280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c29cdd3e-ba20-4c86-abf5-dc72e7ffa64d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:01.053265 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-c29cdd3e-ba20-4c86-abf5-dc72e7ffa64d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:01.061514 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-c29cdd3e-ba20-4c86-abf5-dc72e7ffa64d tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 200 len: 1507 microversion: 2.1 time: 0.214349 Aug 09 18:24:01.062167 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 404/785] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:00 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 1507 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:01.082782 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-bfbe77a4-9eaf-4cff-bb42-4208a7bc9f2f req-874e9382-34c0-4575-b9f2-f59267c027d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d6f4e3-a426-423e-960e-05c7bac110c9", "name": "network-vif-deleted", "tag": "537d9a41-70d0-468a-aa6e-efa9b91a431a"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:24:01.093931 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-bfbe77a4-9eaf-4cff-bb42-4208a7bc9f2f req-874e9382-34c0-4575-b9f2-f59267c027d7 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:01.094534 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-bfbe77a4-9eaf-4cff-bb42-4208a7bc9f2f req-874e9382-34c0-4575-b9f2-f59267c027d7 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:01.095049 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-bfbe77a4-9eaf-4cff-bb42-4208a7bc9f2f req-874e9382-34c0-4575-b9f2-f59267c027d7 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:01.106006 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-bfbe77a4-9eaf-4cff-bb42-4208a7bc9f2f req-874e9382-34c0-4575-b9f2-f59267c027d7 service nova] Creating event network-vif-deleted:537d9a41-70d0-468a-aa6e-efa9b91a431a for instance 67d6f4e3-a426-423e-960e-05c7bac110c9 on hv-cinder-79797 Aug 09 18:24:01.111310 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-bfbe77a4-9eaf-4cff-bb42-4208a7bc9f2f req-874e9382-34c0-4575-b9f2-f59267c027d7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032775 Aug 09 18:24:01.111964 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 382/786] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:24:02.083497 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9fb2713f-fa7d-48f4-9cdb-abd91e2896a8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:02.084265 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9fb2713f-fa7d-48f4-9cdb-abd91e2896a8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 67d6f4e3-a426-423e-960e-05c7bac110c9] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:02.090847 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9fb2713f-fa7d-48f4-9cdb-abd91e2896a8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:02.091343 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9fb2713f-fa7d-48f4-9cdb-abd91e2896a8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:02.091786 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9fb2713f-fa7d-48f4-9cdb-abd91e2896a8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:02.092501 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9fb2713f-fa7d-48f4-9cdb-abd91e2896a8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:02.092963 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9fb2713f-fa7d-48f4-9cdb-abd91e2896a8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:02.093417 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9fb2713f-fa7d-48f4-9cdb-abd91e2896a8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:02.106994 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-9fb2713f-fa7d-48f4-9cdb-abd91e2896a8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] HTTP exception thrown: Instance 67d6f4e3-a426-423e-960e-05c7bac110c9 could not be found. Aug 09 18:24:02.108834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9fb2713f-fa7d-48f4-9cdb-abd91e2896a8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Request method failure captured: Aug 09 18:24:02.108834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 HTTP/1.1 Aug 09 18:24:02.108834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:24:02.108834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:24:02.108834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:24:02.108834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:24:02.108834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:24:02.108834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:24:02.108834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:24:02.108834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:24:02.108834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qRIOR_EAMdUNpksmgwcf99FOSSqhVI8tsoIxh3BjiMzTfrXpYksm4wl0XX75hcX4zSB7VEWBHIFqhlPU6iolaNft99hftdwd5BJh27Wa4fHll0E3coSOe8qDBsNwpnORq82KDHpkxKtU9qWPAuGjeYDz1tW8ACtpXpu2MbvQ0yJQ-Q Aug 09 18:24:02.108834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:24:02.108834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:24:02.108834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:24:02.108834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:24:02.108834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:24:02.108834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:24:02.108834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: dbd7e50444cc4ef0873bfac9d9a2d514 Aug 09 18:24:02.108834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-460293175 Aug 09 18:24:02.108834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:24:02.108834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:24:02.110647 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dbd7e50444cc4ef0873bfac9d9a2d514"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dbd7e50444cc4ef0873bfac9d9a2d514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dbd7e50444cc4ef0873bfac9d9a2d514", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dbd7e50444cc4ef0873bfac9d9a2d514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:24:02.110647 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-ServerRescueNegativeTestJSON-460293175 Aug 09 18:24:02.110647 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: dbd7e50444cc4ef0873bfac9d9a2d514 Aug 09 18:24:02.110647 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-460293175 Aug 09 18:24:02.110647 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-ServerRescueNegativeTestJSON-460293175-project Aug 09 18:24:02.110647 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:24:02.110647 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:24:02.110647 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: 18fae6990e4148ff97dec28b204c52df Aug 09 18:24:02.110647 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-ServerRescueNegativeTestJSON-460293175-project Aug 09 18:24:02.110647 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:24:02.110647 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Instance 67d6f4e3-a426-423e-960e-05c7bac110c9 could not be found. Aug 09 18:24:02.110647 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': '67d6f4e3-a426-423e-960e-05c7bac110c9'} Aug 09 18:24:02.111512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:24:02.111512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:24:02.111512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:24:02.111512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:24:02.111512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:24:02.111512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:24:02.111512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:24:02.111512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:24:02.111512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:24:02.111512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:24:02.111512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67d6f4e3-a426-423e-960e-05c7bac110c9 could not be found. Aug 09 18:24:02.111512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:24:02.111512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:24:02.111512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:24:02.111512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:24:02.111512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:24:02.111512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:24:02.111512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:24:02.111512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:24:02.111512 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:24:02.112759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:24:02.112759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:24:02.112759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:24:02.112759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:24:02.112759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:24:02.112759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:24:02.112759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:24:02.112759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67d6f4e3-a426-423e-960e-05c7bac110c9 could not be found. Aug 09 18:24:02.112759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:24:02.112759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:24:02.112759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:24:02.112759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:24:02.112759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:24:02.112759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:24:02.112759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:24:02.112759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:24:02.112759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67d6f4e3-a426-423e-960e-05c7bac110c9 could not be found. Aug 09 18:24:02.112759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:24:02.113870 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9fb2713f-fa7d-48f4-9cdb-abd91e2896a8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Returning 404 to user: Instance 67d6f4e3-a426-423e-960e-05c7bac110c9 could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:24:02.113870 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9fb2713f-fa7d-48f4-9cdb-abd91e2896a8 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9" status: 404 len: 111 microversion: 2.1 time: 0.030953 Aug 09 18:24:02.113870 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 405/787] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:02 2022] GET /compute/v2.1/servers/67d6f4e3-a426-423e-960e-05c7bac110c9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:24:02.120206 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-08b26e5a-c6d0-4519-855b-5136f83c185a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:02.121126 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-08b26e5a-c6d0-4519-855b-5136f83c185a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:02.127742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-08b26e5a-c6d0-4519-855b-5136f83c185a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:02.128355 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-08b26e5a-c6d0-4519-855b-5136f83c185a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:02.128786 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-08b26e5a-c6d0-4519-855b-5136f83c185a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:02.129471 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-08b26e5a-c6d0-4519-855b-5136f83c185a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:02.129922 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-08b26e5a-c6d0-4519-855b-5136f83c185a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:02.130343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-08b26e5a-c6d0-4519-855b-5136f83c185a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:02.155313 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-08b26e5a-c6d0-4519-855b-5136f83c185a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Going to try to terminate instance {{(pid=118314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:24:02.433088 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-08b26e5a-c6d0-4519-855b-5136f83c185a tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "DELETE /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 204 len: 0 microversion: 2.1 time: 0.317144 Aug 09 18:24:02.433622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 383/788] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:24:02 2022] DELETE /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:24:02.442270 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-7f509f51-0da5-4fb0-b26f-e00528d2ec31 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:02.442910 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-7f509f51-0da5-4fb0-b26f-e00528d2ec31 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:02.449058 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7f509f51-0da5-4fb0-b26f-e00528d2ec31 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:02.452298 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7f509f51-0da5-4fb0-b26f-e00528d2ec31 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:02.452298 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7f509f51-0da5-4fb0-b26f-e00528d2ec31 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:02.452298 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7f509f51-0da5-4fb0-b26f-e00528d2ec31 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:02.452298 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7f509f51-0da5-4fb0-b26f-e00528d2ec31 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:02.452696 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7f509f51-0da5-4fb0-b26f-e00528d2ec31 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:02.587874 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-7f509f51-0da5-4fb0-b26f-e00528d2ec31 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:02.596185 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-7f509f51-0da5-4fb0-b26f-e00528d2ec31 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.157842 Aug 09 18:24:02.596746 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 406/789] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:02 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:03.617590 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-7e54a8c2-2d95-4aa9-8124-67a47702284f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:03.618321 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-7e54a8c2-2d95-4aa9-8124-67a47702284f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:03.624611 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7e54a8c2-2d95-4aa9-8124-67a47702284f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:03.625099 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7e54a8c2-2d95-4aa9-8124-67a47702284f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:03.625536 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7e54a8c2-2d95-4aa9-8124-67a47702284f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:03.626222 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7e54a8c2-2d95-4aa9-8124-67a47702284f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:03.627190 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7e54a8c2-2d95-4aa9-8124-67a47702284f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:03.627790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7e54a8c2-2d95-4aa9-8124-67a47702284f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:03.841592 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-7e54a8c2-2d95-4aa9-8124-67a47702284f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:03.849563 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-7e54a8c2-2d95-4aa9-8124-67a47702284f tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1520 microversion: 2.1 time: 0.236169 Aug 09 18:24:03.850161 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 384/790] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:03 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:04.052096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-d479ee54-8aa7-4fbf-be50-ae1ce3add2a3 req-e8629811-c85c-48fb-a646-5a707a012a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55a70796-1659-4326-8c40-f33454bc848c", "name": "network-vif-deleted", "tag": "a941d35f-e7c7-4b47-8838-e16dd1d6f978"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:24:04.062092 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-d479ee54-8aa7-4fbf-be50-ae1ce3add2a3 req-e8629811-c85c-48fb-a646-5a707a012a10 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:04.062571 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-d479ee54-8aa7-4fbf-be50-ae1ce3add2a3 req-e8629811-c85c-48fb-a646-5a707a012a10 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:04.063034 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-d479ee54-8aa7-4fbf-be50-ae1ce3add2a3 req-e8629811-c85c-48fb-a646-5a707a012a10 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:04.076051 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-d479ee54-8aa7-4fbf-be50-ae1ce3add2a3 req-e8629811-c85c-48fb-a646-5a707a012a10 service nova] Creating event network-vif-deleted:a941d35f-e7c7-4b47-8838-e16dd1d6f978 for instance 55a70796-1659-4326-8c40-f33454bc848c on hv-cinder-79797 Aug 09 18:24:04.081840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-d479ee54-8aa7-4fbf-be50-ae1ce3add2a3 req-e8629811-c85c-48fb-a646-5a707a012a10 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034464 Aug 09 18:24:04.093492 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 407/791] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:24:04.871263 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e3fea28e-a046-4c16-8474-0bc96ac7fa9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:04.871888 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e3fea28e-a046-4c16-8474-0bc96ac7fa9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:04.878571 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3fea28e-a046-4c16-8474-0bc96ac7fa9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:04.879015 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3fea28e-a046-4c16-8474-0bc96ac7fa9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:04.879509 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3fea28e-a046-4c16-8474-0bc96ac7fa9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:04.880205 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3fea28e-a046-4c16-8474-0bc96ac7fa9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:04.880660 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3fea28e-a046-4c16-8474-0bc96ac7fa9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:04.881080 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3fea28e-a046-4c16-8474-0bc96ac7fa9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:04.912130 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3fea28e-a046-4c16-8474-0bc96ac7fa9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:04.912605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3fea28e-a046-4c16-8474-0bc96ac7fa9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:04.913054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e3fea28e-a046-4c16-8474-0bc96ac7fa9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:04.913470 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.objects.instance [None req-e3fea28e-a046-4c16-8474-0bc96ac7fa9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lazy-loading 'fault' on Instance uuid 55a70796-1659-4326-8c40-f33454bc848c {{(pid=118314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:24:04.954889 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-e3fea28e-a046-4c16-8474-0bc96ac7fa9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fae6990e4148ff97dec28b204c52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd7e50444cc4ef0873bfac9d9a2d514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:04.961654 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e3fea28e-a046-4c16-8474-0bc96ac7fa9c tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 200 len: 1310 microversion: 2.1 time: 0.094215 Aug 09 18:24:04.962219 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 385/792] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:04 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 1310 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:05.984890 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-704b73ad-861e-4cdc-a884-51fed254ae22 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:05.985660 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-704b73ad-861e-4cdc-a884-51fed254ae22 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] [instance: 55a70796-1659-4326-8c40-f33454bc848c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:05.991843 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-704b73ad-861e-4cdc-a884-51fed254ae22 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:05.992321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-704b73ad-861e-4cdc-a884-51fed254ae22 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:05.992755 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-704b73ad-861e-4cdc-a884-51fed254ae22 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:05.993436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-704b73ad-861e-4cdc-a884-51fed254ae22 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:05.993888 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-704b73ad-861e-4cdc-a884-51fed254ae22 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:05.994307 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-704b73ad-861e-4cdc-a884-51fed254ae22 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:06.007274 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-704b73ad-861e-4cdc-a884-51fed254ae22 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] HTTP exception thrown: Instance 55a70796-1659-4326-8c40-f33454bc848c could not be found. Aug 09 18:24:06.008877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-704b73ad-861e-4cdc-a884-51fed254ae22 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Request method failure captured: Aug 09 18:24:06.008877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c HTTP/1.1 Aug 09 18:24:06.008877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:24:06.008877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:24:06.008877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:24:06.008877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:24:06.008877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:24:06.008877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:24:06.008877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:24:06.008877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:24:06.008877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qRIOR_EAMdUNpksmgwcf99FOSSqhVI8tsoIxh3BjiMzTfrXpYksm4wl0XX75hcX4zSB7VEWBHIFqhlPU6iolaNft99hftdwd5BJh27Wa4fHll0E3coSOe8qDBsNwpnORq82KDHpkxKtU9qWPAuGjeYDz1tW8ACtpXpu2MbvQ0yJQ-Q Aug 09 18:24:06.008877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:24:06.008877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:24:06.008877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:24:06.008877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:24:06.008877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:24:06.008877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:24:06.008877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: dbd7e50444cc4ef0873bfac9d9a2d514 Aug 09 18:24:06.008877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-460293175 Aug 09 18:24:06.008877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:24:06.008877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:24:06.010373 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dbd7e50444cc4ef0873bfac9d9a2d514"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dbd7e50444cc4ef0873bfac9d9a2d514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dbd7e50444cc4ef0873bfac9d9a2d514", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dbd7e50444cc4ef0873bfac9d9a2d514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:24:06.010373 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-ServerRescueNegativeTestJSON-460293175 Aug 09 18:24:06.010373 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: dbd7e50444cc4ef0873bfac9d9a2d514 Aug 09 18:24:06.010373 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-460293175 Aug 09 18:24:06.010373 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-ServerRescueNegativeTestJSON-460293175-project Aug 09 18:24:06.010373 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:24:06.010373 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:24:06.010373 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: 18fae6990e4148ff97dec28b204c52df Aug 09 18:24:06.010373 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-ServerRescueNegativeTestJSON-460293175-project Aug 09 18:24:06.010373 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:24:06.010373 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Instance 55a70796-1659-4326-8c40-f33454bc848c could not be found. Aug 09 18:24:06.010373 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': '55a70796-1659-4326-8c40-f33454bc848c'} Aug 09 18:24:06.011272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:24:06.011272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:24:06.011272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:24:06.011272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:24:06.011272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:24:06.011272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:24:06.011272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:24:06.011272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:24:06.011272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:24:06.011272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:24:06.011272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55a70796-1659-4326-8c40-f33454bc848c could not be found. Aug 09 18:24:06.011272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:24:06.011272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:24:06.011272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:24:06.011272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:24:06.011272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:24:06.011272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:24:06.011272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:24:06.011272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:24:06.011272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:24:06.012666 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:24:06.012666 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:24:06.012666 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:24:06.012666 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:24:06.012666 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:24:06.012666 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:24:06.012666 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:24:06.012666 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55a70796-1659-4326-8c40-f33454bc848c could not be found. Aug 09 18:24:06.012666 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:24:06.012666 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:24:06.012666 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:24:06.012666 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:24:06.012666 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:24:06.012666 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:24:06.012666 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:24:06.012666 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:24:06.012666 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55a70796-1659-4326-8c40-f33454bc848c could not be found. Aug 09 18:24:06.012666 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:24:06.013902 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-704b73ad-861e-4cdc-a884-51fed254ae22 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] Returning 404 to user: Instance 55a70796-1659-4326-8c40-f33454bc848c could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:24:06.013902 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-704b73ad-861e-4cdc-a884-51fed254ae22 tempest-ServerRescueNegativeTestJSON-460293175 tempest-ServerRescueNegativeTestJSON-460293175-project] 10.222.0.36 "GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c" status: 404 len: 111 microversion: 2.1 time: 0.030528 Aug 09 18:24:06.013902 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 408/793] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:05 2022] GET /compute/v2.1/servers/55a70796-1659-4326-8c40-f33454bc848c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:24:21.596223 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-faf6a70b-315f-43fd-81e3-9d67e5638af1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:21.598061 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-faf6a70b-315f-43fd-81e3-9d67e5638af1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:21.600742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=3 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:24:21.601396 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:24:21.606258 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-faf6a70b-315f-43fd-81e3-9d67e5638af1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:21.606777 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-faf6a70b-315f-43fd-81e3-9d67e5638af1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:21.607218 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-faf6a70b-315f-43fd-81e3-9d67e5638af1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:21.607913 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-faf6a70b-315f-43fd-81e3-9d67e5638af1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:21.608522 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-faf6a70b-315f-43fd-81e3-9d67e5638af1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:21.608858 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-faf6a70b-315f-43fd-81e3-9d67e5638af1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:21.640984 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-faf6a70b-315f-43fd-81e3-9d67e5638af1 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049033 Aug 09 18:24:21.641594 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 386/794] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Aug 9 18:24:21 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 18:24:21.711924 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c8a9ad0d-99f2-4a72-969b-95cd2fb7d3ea tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:21.712518 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-c8a9ad0d-99f2-4a72-969b-95cd2fb7d3ea tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:21.716379 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:24:21.717017 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=25 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:24:21.720554 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c8a9ad0d-99f2-4a72-969b-95cd2fb7d3ea tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:21.721042 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c8a9ad0d-99f2-4a72-969b-95cd2fb7d3ea tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:21.721476 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c8a9ad0d-99f2-4a72-969b-95cd2fb7d3ea tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:21.722308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c8a9ad0d-99f2-4a72-969b-95cd2fb7d3ea tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:21.723535 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c8a9ad0d-99f2-4a72-969b-95cd2fb7d3ea tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:21.724074 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c8a9ad0d-99f2-4a72-969b-95cd2fb7d3ea tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:21.749416 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-c8a9ad0d-99f2-4a72-969b-95cd2fb7d3ea tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Going to try to terminate instance {{(pid=118313) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:24:22.000935 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-c8a9ad0d-99f2-4a72-969b-95cd2fb7d3ea tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 204 len: 0 microversion: 2.1 time: 0.294947 Aug 09 18:24:22.001525 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 409/795] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:24:21 2022] DELETE /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:24:22.010389 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-5d98aa38-8425-42d2-974b-8dc410d0177b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:22.011509 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-5d98aa38-8425-42d2-974b-8dc410d0177b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:22.017835 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d98aa38-8425-42d2-974b-8dc410d0177b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:22.018319 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d98aa38-8425-42d2-974b-8dc410d0177b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:22.018874 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d98aa38-8425-42d2-974b-8dc410d0177b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:22.020349 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d98aa38-8425-42d2-974b-8dc410d0177b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:22.020818 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d98aa38-8425-42d2-974b-8dc410d0177b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:22.021300 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d98aa38-8425-42d2-974b-8dc410d0177b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:22.154670 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-5d98aa38-8425-42d2-974b-8dc410d0177b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:22.162833 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-5d98aa38-8425-42d2-974b-8dc410d0177b tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1674 microversion: 2.1 time: 0.156891 Aug 09 18:24:22.163401 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 387/796] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:22 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:23.185176 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-210bf422-aeda-46e2-a588-911fd3a59c51 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:23.186005 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-210bf422-aeda-46e2-a588-911fd3a59c51 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:23.193047 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-210bf422-aeda-46e2-a588-911fd3a59c51 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:23.193546 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-210bf422-aeda-46e2-a588-911fd3a59c51 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:23.193993 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-210bf422-aeda-46e2-a588-911fd3a59c51 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:23.194710 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-210bf422-aeda-46e2-a588-911fd3a59c51 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:23.195191 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-210bf422-aeda-46e2-a588-911fd3a59c51 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:23.195627 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-210bf422-aeda-46e2-a588-911fd3a59c51 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:23.326603 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-210bf422-aeda-46e2-a588-911fd3a59c51 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:23.335261 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-210bf422-aeda-46e2-a588-911fd3a59c51 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1674 microversion: 2.1 time: 0.154319 Aug 09 18:24:23.335832 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 410/797] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:23 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:24.357331 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f7df2617-57ce-48a3-bfd7-4e4c41a3fa6f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:24.357942 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f7df2617-57ce-48a3-bfd7-4e4c41a3fa6f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:24.367236 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f7df2617-57ce-48a3-bfd7-4e4c41a3fa6f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:24.367791 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f7df2617-57ce-48a3-bfd7-4e4c41a3fa6f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:24.368347 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f7df2617-57ce-48a3-bfd7-4e4c41a3fa6f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:24.369446 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f7df2617-57ce-48a3-bfd7-4e4c41a3fa6f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:24.369862 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f7df2617-57ce-48a3-bfd7-4e4c41a3fa6f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:24.370458 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f7df2617-57ce-48a3-bfd7-4e4c41a3fa6f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:24.378836 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-0405ff82-738d-4665-a1f4-a05d6db82ecf req-2e661ad2-7b4f-428d-a891-90732e30d91a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9924434-5f51-4c4e-8355-93e69db65d9e", "name": "network-vif-deleted", "tag": "a5799cfc-e895-4daf-b395-46bd62d8b616"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:24:24.400208 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-0405ff82-738d-4665-a1f4-a05d6db82ecf req-2e661ad2-7b4f-428d-a891-90732e30d91a service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:24.400607 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-0405ff82-738d-4665-a1f4-a05d6db82ecf req-2e661ad2-7b4f-428d-a891-90732e30d91a service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:24.401233 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-0405ff82-738d-4665-a1f4-a05d6db82ecf req-2e661ad2-7b4f-428d-a891-90732e30d91a service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:24.414156 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-0405ff82-738d-4665-a1f4-a05d6db82ecf req-2e661ad2-7b4f-428d-a891-90732e30d91a service nova] Creating event network-vif-deleted:a5799cfc-e895-4daf-b395-46bd62d8b616 for instance e9924434-5f51-4c4e-8355-93e69db65d9e on hv-cinder-79797 Aug 09 18:24:24.419543 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-0405ff82-738d-4665-a1f4-a05d6db82ecf req-2e661ad2-7b4f-428d-a891-90732e30d91a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044238 Aug 09 18:24:24.420401 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 411/798] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:24:24.468461 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f7df2617-57ce-48a3-bfd7-4e4c41a3fa6f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:24.477602 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f7df2617-57ce-48a3-bfd7-4e4c41a3fa6f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1606 microversion: 2.1 time: 0.124021 Aug 09 18:24:24.478179 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 388/799] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:24 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1606 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:25.501339 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-79c0910a-a785-4a18-97a5-336647ecaec9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:25.502040 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-79c0910a-a785-4a18-97a5-336647ecaec9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:25.508869 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-79c0910a-a785-4a18-97a5-336647ecaec9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:25.509299 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-79c0910a-a785-4a18-97a5-336647ecaec9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:25.509741 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-79c0910a-a785-4a18-97a5-336647ecaec9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:25.510446 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-79c0910a-a785-4a18-97a5-336647ecaec9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:25.510937 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-79c0910a-a785-4a18-97a5-336647ecaec9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:25.511372 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-79c0910a-a785-4a18-97a5-336647ecaec9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:25.574553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-79c0910a-a785-4a18-97a5-336647ecaec9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:25.582934 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-79c0910a-a785-4a18-97a5-336647ecaec9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1323 microversion: 2.1 time: 0.085788 Aug 09 18:24:25.585861 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 412/800] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:25 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1323 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:26.604643 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-574a9497-2879-4fe7-9c84-915d6975650f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:26.605251 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-574a9497-2879-4fe7-9c84-915d6975650f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:26.611366 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-574a9497-2879-4fe7-9c84-915d6975650f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:26.611854 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-574a9497-2879-4fe7-9c84-915d6975650f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:26.612378 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-574a9497-2879-4fe7-9c84-915d6975650f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:26.614172 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-574a9497-2879-4fe7-9c84-915d6975650f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:26.614854 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-574a9497-2879-4fe7-9c84-915d6975650f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:26.615416 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-574a9497-2879-4fe7-9c84-915d6975650f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:26.674939 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-574a9497-2879-4fe7-9c84-915d6975650f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:26.682928 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-574a9497-2879-4fe7-9c84-915d6975650f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1323 microversion: 2.1 time: 0.082334 Aug 09 18:24:26.683495 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 389/801] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:26 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1323 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:27.704360 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-4044b625-71f1-47ef-8c5a-61b57e6bda45 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:27.704990 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-4044b625-71f1-47ef-8c5a-61b57e6bda45 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:27.711610 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4044b625-71f1-47ef-8c5a-61b57e6bda45 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:27.712090 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4044b625-71f1-47ef-8c5a-61b57e6bda45 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:27.712526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4044b625-71f1-47ef-8c5a-61b57e6bda45 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:27.713211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4044b625-71f1-47ef-8c5a-61b57e6bda45 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:27.713672 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4044b625-71f1-47ef-8c5a-61b57e6bda45 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:27.714098 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4044b625-71f1-47ef-8c5a-61b57e6bda45 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:27.744705 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4044b625-71f1-47ef-8c5a-61b57e6bda45 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:27.745189 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4044b625-71f1-47ef-8c5a-61b57e6bda45 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:27.745626 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4044b625-71f1-47ef-8c5a-61b57e6bda45 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:27.746069 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.objects.instance [None req-4044b625-71f1-47ef-8c5a-61b57e6bda45 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lazy-loading 'fault' on Instance uuid e9924434-5f51-4c4e-8355-93e69db65d9e {{(pid=118313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:24:27.792029 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4044b625-71f1-47ef-8c5a-61b57e6bda45 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:27.799441 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-4044b625-71f1-47ef-8c5a-61b57e6bda45 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 200 len: 1328 microversion: 2.1 time: 0.099034 Aug 09 18:24:27.800007 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 413/802] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:27 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:28.820175 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e77fb871-574d-4918-8459-869c1d9c7e80 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:28.820994 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e77fb871-574d-4918-8459-869c1d9c7e80 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:28.827411 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e77fb871-574d-4918-8459-869c1d9c7e80 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:28.827888 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e77fb871-574d-4918-8459-869c1d9c7e80 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:28.828319 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e77fb871-574d-4918-8459-869c1d9c7e80 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:28.828992 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e77fb871-574d-4918-8459-869c1d9c7e80 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:28.829446 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e77fb871-574d-4918-8459-869c1d9c7e80 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:28.829858 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e77fb871-574d-4918-8459-869c1d9c7e80 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:28.844447 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-e77fb871-574d-4918-8459-869c1d9c7e80 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] HTTP exception thrown: Instance e9924434-5f51-4c4e-8355-93e69db65d9e could not be found. Aug 09 18:24:28.846083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e77fb871-574d-4918-8459-869c1d9c7e80 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Request method failure captured: Aug 09 18:24:28.846083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e HTTP/1.1 Aug 09 18:24:28.846083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:24:28.846083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:24:28.846083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:24:28.846083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 0 Aug 09 18:24:28.846083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:24:28.846083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:24:28.846083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:24:28.846083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:24:28.846083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qTBVqPk4pl3xjTXh-vq2d9g5Jblc0yO57MGdyZvr84ccuFN_X7CCb-PNCv6uJ_iAzgwKSL7HL9VzncoyOfgA5jaPc66FIOAMazSQ5UgccsSgTmgCY6KqelNNNA8rRkhbZigJN9qQGtEE7r-OFahXTOcT7uQMnCZlOVhfWLSifhlhoU Aug 09 18:24:28.846083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:24:28.846083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:24:28.846083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:24:28.846083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:24:28.846083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:24:28.846083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:24:28.846083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: b23fb97c7c4049c49f6bad8418fc4dec Aug 09 18:24:28.846083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-AttachVolumeTestJSON-1043964365 Aug 09 18:24:28.846083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:24:28.846083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:24:28.848252 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b23fb97c7c4049c49f6bad8418fc4dec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b23fb97c7c4049c49f6bad8418fc4dec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b23fb97c7c4049c49f6bad8418fc4dec", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b23fb97c7c4049c49f6bad8418fc4dec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:24:28.848252 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-AttachVolumeTestJSON-1043964365 Aug 09 18:24:28.848252 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: b23fb97c7c4049c49f6bad8418fc4dec Aug 09 18:24:28.848252 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1043964365 Aug 09 18:24:28.848252 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-AttachVolumeTestJSON-1043964365-project Aug 09 18:24:28.848252 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:24:28.848252 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:24:28.848252 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: a6c7401eaf744ef895bacc294f7c6268 Aug 09 18:24:28.848252 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-AttachVolumeTestJSON-1043964365-project Aug 09 18:24:28.848252 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: > Aug 09 18:24:28.848252 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Instance e9924434-5f51-4c4e-8355-93e69db65d9e could not be found. Aug 09 18:24:28.848252 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'id': 'e9924434-5f51-4c4e-8355-93e69db65d9e'} Aug 09 18:24:28.849176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:24:28.849176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:24:28.849176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:24:28.849176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:24:28.849176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:24:28.849176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:24:28.849176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:24:28.849176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:24:28.849176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:24:28.849176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:24:28.849176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9924434-5f51-4c4e-8355-93e69db65d9e could not be found. Aug 09 18:24:28.849176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:24:28.849176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:24:28.849176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:24:28.849176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:24:28.849176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:24:28.849176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:24:28.849176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:24:28.849176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:24:28.849176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:24:28.850787 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:24:28.850787 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:24:28.850787 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:24:28.850787 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:24:28.850787 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:24:28.850787 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:24:28.850787 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:24:28.850787 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9924434-5f51-4c4e-8355-93e69db65d9e could not be found. Aug 09 18:24:28.850787 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:24:28.850787 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:24:28.850787 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:24:28.850787 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:24:28.850787 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:24:28.850787 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:24:28.850787 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:24:28.850787 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:24:28.850787 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9924434-5f51-4c4e-8355-93e69db65d9e could not be found. Aug 09 18:24:28.850787 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:24:28.852194 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e77fb871-574d-4918-8459-869c1d9c7e80 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Returning 404 to user: Instance e9924434-5f51-4c4e-8355-93e69db65d9e could not be found. {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:24:28.852194 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e77fb871-574d-4918-8459-869c1d9c7e80 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 404 len: 111 microversion: 2.1 time: 0.031831 Aug 09 18:24:28.852194 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 390/803] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:28 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:24:28.857088 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-3a7f14ca-a169-4edd-875d-a099ab755237 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '.version_select at 0x7f4c35290550>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:28.928435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-3a7f14ca-a169-4edd-875d-a099ab755237 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1979419076" status: 202 len: 0 microversion: 2.1 time: 0.075136 Aug 09 18:24:28.929059 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 414/804] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Aug 9 18:24:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1979419076 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:24:29.725587 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-3048cc9c-7abf-4da3-861e-849354c28e91 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Action: 'create', calling method: .version_select at 0x7f4c352ea160>, body: {"keypair": {"name": "tempest-keypair-88294841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxiKVC7MPa6oV/PViSr5dp+9npUrzqL13vHF2iYSjUWVY0/II2SKYGoSdO9Tb8LulxAJiZ23fG3UYLCw4iYM/0WybhJpiaabbpAUXt6IReKbNrUBgqHMWPqeNib/0jHkw=="}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:24:29.741719 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-3048cc9c-7abf-4da3-861e-849354c28e91 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Getting quotas for project b23fb97c7c4049c49f6bad8418fc4dec. Resources: {'key_pairs'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:24:29.745551 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-3048cc9c-7abf-4da3-861e-849354c28e91 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Getting quotas for user a6c7401eaf744ef895bacc294f7c6268 and project b23fb97c7c4049c49f6bad8418fc4dec. Resources: {'key_pairs'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:24:29.836319 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-3048cc9c-7abf-4da3-861e-849354c28e91 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.115338 Aug 09 18:24:29.836953 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 391/805] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Aug 9 18:24:29 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:24:32.024979 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-aad13b63-e1c0-47e6-a754-7e9db9f7a616 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:24:32.027154 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-aad13b63-e1c0-47e6-a754-7e9db9f7a616 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:32.033755 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-aad13b63-e1c0-47e6-a754-7e9db9f7a616 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:32.034229 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-aad13b63-e1c0-47e6-a754-7e9db9f7a616 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:32.034665 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-aad13b63-e1c0-47e6-a754-7e9db9f7a616 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:32.035393 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-aad13b63-e1c0-47e6-a754-7e9db9f7a616 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:32.035854 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-aad13b63-e1c0-47e6-a754-7e9db9f7a616 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:32.036809 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-aad13b63-e1c0-47e6-a754-7e9db9f7a616 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:32.112791 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-3ee4ba86-0444-4633-be33-00d62c37d85f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1113230187", "imageRef": "53732c26-c942-4646-ac3f-8d9e11ab4d57", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe6eacbf-4230-4c49-b44c-fd306b86f924"}], "security_groups": [{"name": "tempest-securitygroup--1615016399"}], "key_name": "tempest-keypair-88294841", "user_data": "}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:24:32.219138 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.network.neutron [None req-3ee4ba86-0444-4633-be33-00d62c37d85f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] validate_networks() for [('fe6eacbf-4230-4c49-b44c-fd306b86f924', None, None, None, None, None)] {{(pid=118314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:24:32.226403 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-aad13b63-e1c0-47e6-a754-7e9db9f7a616 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "POST /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8/action" status: 202 len: 0 microversion: 2.1 time: 0.205400 Aug 09 18:24:32.227493 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 415/806] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Aug 9 18:24:32 2022] POST /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:24:32.235998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-1774cb48-77bd-4bd3-a96d-9a7585443100 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:32.237010 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-1774cb48-77bd-4bd3-a96d-9a7585443100 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:32.245004 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1774cb48-77bd-4bd3-a96d-9a7585443100 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:32.245004 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1774cb48-77bd-4bd3-a96d-9a7585443100 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:32.245004 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1774cb48-77bd-4bd3-a96d-9a7585443100 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:32.245527 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1774cb48-77bd-4bd3-a96d-9a7585443100 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:32.245982 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1774cb48-77bd-4bd3-a96d-9a7585443100 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:32.246404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1774cb48-77bd-4bd3-a96d-9a7585443100 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:32.539839 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-1774cb48-77bd-4bd3-a96d-9a7585443100 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:32.547894 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-1774cb48-77bd-4bd3-a96d-9a7585443100 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1753 microversion: 2.1 time: 0.316257 Aug 09 18:24:32.550607 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 416/807] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:32 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1753 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:32.906002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-3ee4ba86-0444-4633-be33-00d62c37d85f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Flavor limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:24:32.906425 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-3ee4ba86-0444-4633-be33-00d62c37d85f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Image limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:24:32.907153 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-3ee4ba86-0444-4633-be33-00d62c37d85f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Flavor pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:24:32.907758 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-3ee4ba86-0444-4633-be33-00d62c37d85f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Image pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:24:32.908180 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-3ee4ba86-0444-4633-be33-00d62c37d85f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:24:32.917194 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3ee4ba86-0444-4633-be33-00d62c37d85f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:32.917679 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3ee4ba86-0444-4633-be33-00d62c37d85f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:32.918330 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3ee4ba86-0444-4633-be33-00d62c37d85f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:32.919149 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3ee4ba86-0444-4633-be33-00d62c37d85f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:32.919609 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3ee4ba86-0444-4633-be33-00d62c37d85f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:32.920047 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3ee4ba86-0444-4633-be33-00d62c37d85f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:32.939500 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-3ee4ba86-0444-4633-be33-00d62c37d85f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Getting quotas for project b23fb97c7c4049c49f6bad8418fc4dec. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:24:32.944157 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-3ee4ba86-0444-4633-be33-00d62c37d85f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Getting quotas for user a6c7401eaf744ef895bacc294f7c6268 and project b23fb97c7c4049c49f6bad8418fc4dec. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:24:32.955415 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-3ee4ba86-0444-4633-be33-00d62c37d85f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Going to run 1 instances... {{(pid=118314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:24:32.957721 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-3ee4ba86-0444-4633-be33-00d62c37d85f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53732c26-c942-4646-ac3f-8d9e11ab4d57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:24:33.088408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-3ee4ba86-0444-4633-be33-00d62c37d85f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.980538 Aug 09 18:24:33.089305 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 392/808] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Aug 9 18:24:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:24:33.100391 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-4f3af428-2f15-419a-a66c-d93ce742cd74 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:33.104528 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-4f3af428-2f15-419a-a66c-d93ce742cd74 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:33.160835 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4f3af428-2f15-419a-a66c-d93ce742cd74 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:33.169195 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-4f3af428-2f15-419a-a66c-d93ce742cd74 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e" status: 200 len: 1236 microversion: 2.1 time: 0.072964 Aug 09 18:24:33.169764 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 417/809] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:33 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e => generated 1236 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:33.571195 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8260e722-9191-4221-9b3f-146fba773541 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:33.572414 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8260e722-9191-4221-9b3f-146fba773541 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:33.579394 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8260e722-9191-4221-9b3f-146fba773541 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:33.580067 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8260e722-9191-4221-9b3f-146fba773541 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:33.580704 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8260e722-9191-4221-9b3f-146fba773541 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:33.581372 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8260e722-9191-4221-9b3f-146fba773541 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:33.581957 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8260e722-9191-4221-9b3f-146fba773541 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:33.582297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8260e722-9191-4221-9b3f-146fba773541 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:33.743134 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8260e722-9191-4221-9b3f-146fba773541 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:33.751767 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8260e722-9191-4221-9b3f-146fba773541 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1753 microversion: 2.1 time: 0.185097 Aug 09 18:24:33.752738 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 393/810] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:33 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1753 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:34.190317 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9aa1be4d-a9b6-4d03-aaee-547609a4473c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:34.191006 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9aa1be4d-a9b6-4d03-aaee-547609a4473c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:34.198644 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9aa1be4d-a9b6-4d03-aaee-547609a4473c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:34.199170 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9aa1be4d-a9b6-4d03-aaee-547609a4473c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:34.199613 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9aa1be4d-a9b6-4d03-aaee-547609a4473c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:34.200314 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9aa1be4d-a9b6-4d03-aaee-547609a4473c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:34.200778 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9aa1be4d-a9b6-4d03-aaee-547609a4473c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:34.201211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9aa1be4d-a9b6-4d03-aaee-547609a4473c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:34.264925 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9aa1be4d-a9b6-4d03-aaee-547609a4473c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:34.274478 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9aa1be4d-a9b6-4d03-aaee-547609a4473c tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e" status: 200 len: 1240 microversion: 2.1 time: 0.087956 Aug 09 18:24:34.275423 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 418/811] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:34 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:34.773272 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-4d94d41e-1b18-4e3a-a3fc-591cbc2de491 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:34.773881 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-4d94d41e-1b18-4e3a-a3fc-591cbc2de491 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:34.780489 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4d94d41e-1b18-4e3a-a3fc-591cbc2de491 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:34.780966 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4d94d41e-1b18-4e3a-a3fc-591cbc2de491 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:34.781400 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4d94d41e-1b18-4e3a-a3fc-591cbc2de491 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:34.782088 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4d94d41e-1b18-4e3a-a3fc-591cbc2de491 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:34.782638 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4d94d41e-1b18-4e3a-a3fc-591cbc2de491 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:34.783081 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4d94d41e-1b18-4e3a-a3fc-591cbc2de491 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:34.937025 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-4d94d41e-1b18-4e3a-a3fc-591cbc2de491 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:34.946899 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-4d94d41e-1b18-4e3a-a3fc-591cbc2de491 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1758 microversion: 2.1 time: 0.177383 Aug 09 18:24:34.947466 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 394/812] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:34 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:35.296827 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5100b747-3768-492c-b7c0-99771fbc1262 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:35.298622 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-5100b747-3768-492c-b7c0-99771fbc1262 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:35.306986 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5100b747-3768-492c-b7c0-99771fbc1262 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:35.307481 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5100b747-3768-492c-b7c0-99771fbc1262 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:35.308129 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5100b747-3768-492c-b7c0-99771fbc1262 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:35.308832 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5100b747-3768-492c-b7c0-99771fbc1262 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:35.309285 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5100b747-3768-492c-b7c0-99771fbc1262 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:35.310340 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5100b747-3768-492c-b7c0-99771fbc1262 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:35.384477 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-5100b747-3768-492c-b7c0-99771fbc1262 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:35.392940 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-5100b747-3768-492c-b7c0-99771fbc1262 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e" status: 200 len: 1296 microversion: 2.1 time: 0.100523 Aug 09 18:24:35.393513 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 419/813] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:35 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e => generated 1296 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:35.968408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f2c2b2b9-145e-45f5-93e1-dd1e16fc015e tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:35.969018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f2c2b2b9-145e-45f5-93e1-dd1e16fc015e tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:35.976386 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f2c2b2b9-145e-45f5-93e1-dd1e16fc015e tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:35.976876 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f2c2b2b9-145e-45f5-93e1-dd1e16fc015e tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:35.977311 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f2c2b2b9-145e-45f5-93e1-dd1e16fc015e tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:35.978002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f2c2b2b9-145e-45f5-93e1-dd1e16fc015e tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:35.978456 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f2c2b2b9-145e-45f5-93e1-dd1e16fc015e tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:35.978943 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f2c2b2b9-145e-45f5-93e1-dd1e16fc015e tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:36.218827 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f2c2b2b9-145e-45f5-93e1-dd1e16fc015e tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:36.228601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f2c2b2b9-145e-45f5-93e1-dd1e16fc015e tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1758 microversion: 2.1 time: 0.264009 Aug 09 18:24:36.229496 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 395/814] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:35 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1758 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:36.419051 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-07b17cd7-dbce-45e9-99a8-2ee7e075e126 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:36.419787 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-07b17cd7-dbce-45e9-99a8-2ee7e075e126 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:36.426589 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-07b17cd7-dbce-45e9-99a8-2ee7e075e126 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:36.427617 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-07b17cd7-dbce-45e9-99a8-2ee7e075e126 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:36.428458 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-07b17cd7-dbce-45e9-99a8-2ee7e075e126 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:36.429175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-07b17cd7-dbce-45e9-99a8-2ee7e075e126 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:36.429666 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-07b17cd7-dbce-45e9-99a8-2ee7e075e126 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:36.430093 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-07b17cd7-dbce-45e9-99a8-2ee7e075e126 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:36.733274 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-07b17cd7-dbce-45e9-99a8-2ee7e075e126 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:36.741700 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-07b17cd7-dbce-45e9-99a8-2ee7e075e126 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e" status: 200 len: 1362 microversion: 2.1 time: 0.326052 Aug 09 18:24:36.751134 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 420/815] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:36 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e => generated 1362 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:37.156694 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-42f7760c-d9ef-4737-a504-65819640b8c6 req-75a71fc8-1c5e-4ff8-bbc5-7502e5bd562d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2380477-dae7-428a-a5ba-ee0b14d8e91e", "tag": "057b2422-5227-4c13-8c4d-5c89abcdb889"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:24:37.176297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-42f7760c-d9ef-4737-a504-65819640b8c6 req-75a71fc8-1c5e-4ff8-bbc5-7502e5bd562d service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:37.177444 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-42f7760c-d9ef-4737-a504-65819640b8c6 req-75a71fc8-1c5e-4ff8-bbc5-7502e5bd562d service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:37.177983 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-42f7760c-d9ef-4737-a504-65819640b8c6 req-75a71fc8-1c5e-4ff8-bbc5-7502e5bd562d service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:37.190274 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-42f7760c-d9ef-4737-a504-65819640b8c6 req-75a71fc8-1c5e-4ff8-bbc5-7502e5bd562d service nova] Creating event network-changed:057b2422-5227-4c13-8c4d-5c89abcdb889 for instance b2380477-dae7-428a-a5ba-ee0b14d8e91e on hv-cinder-79797 Aug 09 18:24:37.195518 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-42f7760c-d9ef-4737-a504-65819640b8c6 req-75a71fc8-1c5e-4ff8-bbc5-7502e5bd562d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042492 Aug 09 18:24:37.196669 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 396/816] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:24:37.250483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f928e8a4-dea2-44c0-a94c-cc7d29d61f48 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:37.251160 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f928e8a4-dea2-44c0-a94c-cc7d29d61f48 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:37.257462 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f928e8a4-dea2-44c0-a94c-cc7d29d61f48 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:37.257961 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f928e8a4-dea2-44c0-a94c-cc7d29d61f48 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:37.258405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f928e8a4-dea2-44c0-a94c-cc7d29d61f48 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:37.259260 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f928e8a4-dea2-44c0-a94c-cc7d29d61f48 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:37.259706 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f928e8a4-dea2-44c0-a94c-cc7d29d61f48 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:37.260143 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f928e8a4-dea2-44c0-a94c-cc7d29d61f48 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:37.495042 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f928e8a4-dea2-44c0-a94c-cc7d29d61f48 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:37.506777 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f928e8a4-dea2-44c0-a94c-cc7d29d61f48 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1758 microversion: 2.1 time: 0.259027 Aug 09 18:24:37.519344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 421/817] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:37 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1758 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:37.763764 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-6e4ec4db-0622-41ee-ab6b-c9e9bdf1c38a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:37.764828 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-6e4ec4db-0622-41ee-ab6b-c9e9bdf1c38a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:37.770883 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6e4ec4db-0622-41ee-ab6b-c9e9bdf1c38a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:37.771645 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6e4ec4db-0622-41ee-ab6b-c9e9bdf1c38a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:37.772085 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6e4ec4db-0622-41ee-ab6b-c9e9bdf1c38a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:37.773055 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6e4ec4db-0622-41ee-ab6b-c9e9bdf1c38a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:37.773668 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6e4ec4db-0622-41ee-ab6b-c9e9bdf1c38a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:37.774254 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6e4ec4db-0622-41ee-ab6b-c9e9bdf1c38a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:37.909477 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-6e4ec4db-0622-41ee-ab6b-c9e9bdf1c38a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:37.917955 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-6e4ec4db-0622-41ee-ab6b-c9e9bdf1c38a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e" status: 200 len: 1362 microversion: 2.1 time: 0.159306 Aug 09 18:24:37.931173 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 397/818] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:37 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:38.532617 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-09b57462-2a3d-4dec-a82c-c3c4d2310863 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:38.533214 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-09b57462-2a3d-4dec-a82c-c3c4d2310863 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:38.540461 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-09b57462-2a3d-4dec-a82c-c3c4d2310863 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:38.541159 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-09b57462-2a3d-4dec-a82c-c3c4d2310863 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:38.541606 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-09b57462-2a3d-4dec-a82c-c3c4d2310863 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:38.542306 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-09b57462-2a3d-4dec-a82c-c3c4d2310863 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:38.542791 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-09b57462-2a3d-4dec-a82c-c3c4d2310863 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:38.543223 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-09b57462-2a3d-4dec-a82c-c3c4d2310863 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:38.692196 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-09b57462-2a3d-4dec-a82c-c3c4d2310863 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:38.700730 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-09b57462-2a3d-4dec-a82c-c3c4d2310863 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1758 microversion: 2.1 time: 0.172168 Aug 09 18:24:38.701357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 422/819] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:38 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:38.939597 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c1d9652e-11ee-4e83-bd1b-72e04b230fba tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:38.940211 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c1d9652e-11ee-4e83-bd1b-72e04b230fba tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:38.946618 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c1d9652e-11ee-4e83-bd1b-72e04b230fba tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:38.947141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c1d9652e-11ee-4e83-bd1b-72e04b230fba tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:38.947578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c1d9652e-11ee-4e83-bd1b-72e04b230fba tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:38.948272 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c1d9652e-11ee-4e83-bd1b-72e04b230fba tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:38.948723 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c1d9652e-11ee-4e83-bd1b-72e04b230fba tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:38.949146 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c1d9652e-11ee-4e83-bd1b-72e04b230fba tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:39.109149 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c1d9652e-11ee-4e83-bd1b-72e04b230fba tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:39.116840 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c1d9652e-11ee-4e83-bd1b-72e04b230fba tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e" status: 200 len: 1362 microversion: 2.1 time: 0.181041 Aug 09 18:24:39.118914 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 398/820] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:38 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:39.721599 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-96a0fa9e-7d14-4ddd-bcdd-ab962de0af05 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:39.722210 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-96a0fa9e-7d14-4ddd-bcdd-ab962de0af05 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:39.728746 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-96a0fa9e-7d14-4ddd-bcdd-ab962de0af05 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:39.729231 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-96a0fa9e-7d14-4ddd-bcdd-ab962de0af05 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:39.729668 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-96a0fa9e-7d14-4ddd-bcdd-ab962de0af05 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:39.730352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-96a0fa9e-7d14-4ddd-bcdd-ab962de0af05 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:39.730833 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-96a0fa9e-7d14-4ddd-bcdd-ab962de0af05 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:39.731256 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-96a0fa9e-7d14-4ddd-bcdd-ab962de0af05 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:39.873572 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-96a0fa9e-7d14-4ddd-bcdd-ab962de0af05 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:39.882343 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-96a0fa9e-7d14-4ddd-bcdd-ab962de0af05 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1758 microversion: 2.1 time: 0.164532 Aug 09 18:24:39.882869 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 423/821] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:39 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:40.143711 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-572958bd-8d31-431f-8418-c5a91e847c31 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:40.145117 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-572958bd-8d31-431f-8418-c5a91e847c31 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:40.157882 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-572958bd-8d31-431f-8418-c5a91e847c31 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:40.161870 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-572958bd-8d31-431f-8418-c5a91e847c31 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:40.161870 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-572958bd-8d31-431f-8418-c5a91e847c31 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:40.161870 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-572958bd-8d31-431f-8418-c5a91e847c31 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:40.163037 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-572958bd-8d31-431f-8418-c5a91e847c31 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:40.163798 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-572958bd-8d31-431f-8418-c5a91e847c31 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:40.334794 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-572958bd-8d31-431f-8418-c5a91e847c31 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:40.342129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-572958bd-8d31-431f-8418-c5a91e847c31 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e" status: 200 len: 1362 microversion: 2.1 time: 0.206423 Aug 09 18:24:40.342689 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 399/822] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:40 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:40.904111 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-26c1c052-94ef-4f57-9f8b-d7d2906d7c08 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:40.904656 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-26c1c052-94ef-4f57-9f8b-d7d2906d7c08 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:40.911499 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-26c1c052-94ef-4f57-9f8b-d7d2906d7c08 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:40.911990 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-26c1c052-94ef-4f57-9f8b-d7d2906d7c08 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:40.912433 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-26c1c052-94ef-4f57-9f8b-d7d2906d7c08 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:40.913127 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-26c1c052-94ef-4f57-9f8b-d7d2906d7c08 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:40.913586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-26c1c052-94ef-4f57-9f8b-d7d2906d7c08 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:40.914014 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-26c1c052-94ef-4f57-9f8b-d7d2906d7c08 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:41.061105 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-26c1c052-94ef-4f57-9f8b-d7d2906d7c08 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:41.069644 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-26c1c052-94ef-4f57-9f8b-d7d2906d7c08 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1758 microversion: 2.1 time: 0.169556 Aug 09 18:24:41.070202 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 424/823] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:40 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:41.363328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-41dd3d51-c68d-42e3-bd3b-5d932425912e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:41.363928 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-41dd3d51-c68d-42e3-bd3b-5d932425912e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:41.371090 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-41dd3d51-c68d-42e3-bd3b-5d932425912e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:41.371573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-41dd3d51-c68d-42e3-bd3b-5d932425912e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:41.372001 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-41dd3d51-c68d-42e3-bd3b-5d932425912e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:41.373019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-41dd3d51-c68d-42e3-bd3b-5d932425912e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:41.373471 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-41dd3d51-c68d-42e3-bd3b-5d932425912e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:41.373893 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-41dd3d51-c68d-42e3-bd3b-5d932425912e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:41.513443 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-41dd3d51-c68d-42e3-bd3b-5d932425912e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:41.521024 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-41dd3d51-c68d-42e3-bd3b-5d932425912e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e" status: 200 len: 1362 microversion: 2.1 time: 0.161751 Aug 09 18:24:41.521709 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 400/824] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:41 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:42.093293 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a226f9b5-58a6-415e-b44b-6dcc20d13d2f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:42.093882 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a226f9b5-58a6-415e-b44b-6dcc20d13d2f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:42.100887 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a226f9b5-58a6-415e-b44b-6dcc20d13d2f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:42.101370 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a226f9b5-58a6-415e-b44b-6dcc20d13d2f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:42.101800 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a226f9b5-58a6-415e-b44b-6dcc20d13d2f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:42.102484 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a226f9b5-58a6-415e-b44b-6dcc20d13d2f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:42.102963 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a226f9b5-58a6-415e-b44b-6dcc20d13d2f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:42.103483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a226f9b5-58a6-415e-b44b-6dcc20d13d2f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:42.107427 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:24:42.249791 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a226f9b5-58a6-415e-b44b-6dcc20d13d2f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:42.258435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a226f9b5-58a6-415e-b44b-6dcc20d13d2f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1758 microversion: 2.1 time: 0.169476 Aug 09 18:24:42.259037 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 425/825] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:42 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:42.374270 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-49a16cfc-bcb0-47a0-b94a-7f3c35d65361 req-a98e8f5a-94a6-4e90-9612-606cc8402853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2380477-dae7-428a-a5ba-ee0b14d8e91e", "name": "network-vif-plugged", "status": "completed", "tag": "057b2422-5227-4c13-8c4d-5c89abcdb889"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:24:42.385536 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-49a16cfc-bcb0-47a0-b94a-7f3c35d65361 req-a98e8f5a-94a6-4e90-9612-606cc8402853 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:42.386007 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-49a16cfc-bcb0-47a0-b94a-7f3c35d65361 req-a98e8f5a-94a6-4e90-9612-606cc8402853 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:42.386438 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-49a16cfc-bcb0-47a0-b94a-7f3c35d65361 req-a98e8f5a-94a6-4e90-9612-606cc8402853 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:42.399766 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-49a16cfc-bcb0-47a0-b94a-7f3c35d65361 req-a98e8f5a-94a6-4e90-9612-606cc8402853 service nova] Creating event network-vif-plugged:057b2422-5227-4c13-8c4d-5c89abcdb889 for instance b2380477-dae7-428a-a5ba-ee0b14d8e91e on hv-cinder-79797 Aug 09 18:24:42.403403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-49a16cfc-bcb0-47a0-b94a-7f3c35d65361 req-a98e8f5a-94a6-4e90-9612-606cc8402853 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033145 Aug 09 18:24:42.403983 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 401/826] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:24:42.542579 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-08e05dc2-631b-4e0b-ae87-2e299ced85fd tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:42.543283 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-08e05dc2-631b-4e0b-ae87-2e299ced85fd tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:42.549862 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-08e05dc2-631b-4e0b-ae87-2e299ced85fd tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:42.550337 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-08e05dc2-631b-4e0b-ae87-2e299ced85fd tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:42.550889 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-08e05dc2-631b-4e0b-ae87-2e299ced85fd tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:42.551643 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-08e05dc2-631b-4e0b-ae87-2e299ced85fd tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:42.552811 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-08e05dc2-631b-4e0b-ae87-2e299ced85fd tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:42.553431 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-08e05dc2-631b-4e0b-ae87-2e299ced85fd tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:42.697139 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-08e05dc2-631b-4e0b-ae87-2e299ced85fd tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:42.720731 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-08e05dc2-631b-4e0b-ae87-2e299ced85fd tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e" status: 200 len: 1362 microversion: 2.1 time: 0.182111 Aug 09 18:24:42.722756 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 426/827] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:42 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:43.277635 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=2 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:24:43.278514 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=10 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:24:43.282569 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-7e6e92a3-89ac-4828-a1d0-c71eab139782 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:43.283300 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-7e6e92a3-89ac-4828-a1d0-c71eab139782 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:43.290150 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7e6e92a3-89ac-4828-a1d0-c71eab139782 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:43.290637 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7e6e92a3-89ac-4828-a1d0-c71eab139782 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:43.291734 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7e6e92a3-89ac-4828-a1d0-c71eab139782 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:43.291868 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7e6e92a3-89ac-4828-a1d0-c71eab139782 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:43.292211 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7e6e92a3-89ac-4828-a1d0-c71eab139782 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:43.292638 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7e6e92a3-89ac-4828-a1d0-c71eab139782 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:43.440346 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-7e6e92a3-89ac-4828-a1d0-c71eab139782 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:43.448935 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-7e6e92a3-89ac-4828-a1d0-c71eab139782 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1758 microversion: 2.1 time: 0.172186 Aug 09 18:24:43.449510 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 402/828] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:43 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:43.743888 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-7554d6e6-5e64-4ab2-9bb5-12b1d2250760 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:43.744626 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-7554d6e6-5e64-4ab2-9bb5-12b1d2250760 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:43.746937 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=2 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:24:43.751811 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7554d6e6-5e64-4ab2-9bb5-12b1d2250760 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:43.752300 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7554d6e6-5e64-4ab2-9bb5-12b1d2250760 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:43.755208 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7554d6e6-5e64-4ab2-9bb5-12b1d2250760 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:43.755208 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7554d6e6-5e64-4ab2-9bb5-12b1d2250760 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:43.755208 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7554d6e6-5e64-4ab2-9bb5-12b1d2250760 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:43.755208 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7554d6e6-5e64-4ab2-9bb5-12b1d2250760 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:43.894796 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-7554d6e6-5e64-4ab2-9bb5-12b1d2250760 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:43.903069 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-7554d6e6-5e64-4ab2-9bb5-12b1d2250760 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e" status: 200 len: 1362 microversion: 2.1 time: 0.163286 Aug 09 18:24:43.903625 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 427/829] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:43 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:44.472808 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-ff5d3a89-818d-4a26-9c8b-d8cd61a121cf tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:44.473475 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-ff5d3a89-818d-4a26-9c8b-d8cd61a121cf tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:44.480252 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ff5d3a89-818d-4a26-9c8b-d8cd61a121cf tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:44.480726 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ff5d3a89-818d-4a26-9c8b-d8cd61a121cf tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:44.481151 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ff5d3a89-818d-4a26-9c8b-d8cd61a121cf tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:44.481826 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ff5d3a89-818d-4a26-9c8b-d8cd61a121cf tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:44.482272 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ff5d3a89-818d-4a26-9c8b-d8cd61a121cf tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:44.482685 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ff5d3a89-818d-4a26-9c8b-d8cd61a121cf tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:44.634349 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-ff5d3a89-818d-4a26-9c8b-d8cd61a121cf tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:44.642791 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-ff5d3a89-818d-4a26-9c8b-d8cd61a121cf tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1758 microversion: 2.1 time: 0.173798 Aug 09 18:24:44.648771 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 403/830] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:44 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:44.923577 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-3c54f8bd-1744-41b7-bdcc-950a11ab8707 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:44.928274 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-3c54f8bd-1744-41b7-bdcc-950a11ab8707 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:44.930850 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3c54f8bd-1744-41b7-bdcc-950a11ab8707 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:44.931339 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3c54f8bd-1744-41b7-bdcc-950a11ab8707 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:44.931780 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3c54f8bd-1744-41b7-bdcc-950a11ab8707 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:44.932479 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3c54f8bd-1744-41b7-bdcc-950a11ab8707 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:44.932934 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3c54f8bd-1744-41b7-bdcc-950a11ab8707 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:44.933365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3c54f8bd-1744-41b7-bdcc-950a11ab8707 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:45.070934 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-3c54f8bd-1744-41b7-bdcc-950a11ab8707 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:45.078316 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-3c54f8bd-1744-41b7-bdcc-950a11ab8707 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e" status: 200 len: 1549 microversion: 2.1 time: 0.158760 Aug 09 18:24:45.078901 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 428/831] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:44 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:45.099985 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-6f79b65a-412e-4222-a4e0-b8ddcc19c97f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:45.100564 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-6f79b65a-412e-4222-a4e0-b8ddcc19c97f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:45.106559 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6f79b65a-412e-4222-a4e0-b8ddcc19c97f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:45.107073 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6f79b65a-412e-4222-a4e0-b8ddcc19c97f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:45.107515 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6f79b65a-412e-4222-a4e0-b8ddcc19c97f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:45.108196 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6f79b65a-412e-4222-a4e0-b8ddcc19c97f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:45.108648 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6f79b65a-412e-4222-a4e0-b8ddcc19c97f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:45.109324 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6f79b65a-412e-4222-a4e0-b8ddcc19c97f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:45.185592 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-6f79b65a-412e-4222-a4e0-b8ddcc19c97f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090160 Aug 09 18:24:45.186191 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 404/832] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Aug 9 18:24:45 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:24:45.664806 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-4168c3a0-1655-4010-9617-299067e92efe tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:45.665556 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-4168c3a0-1655-4010-9617-299067e92efe tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:45.671757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4168c3a0-1655-4010-9617-299067e92efe tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:45.672252 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4168c3a0-1655-4010-9617-299067e92efe tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:45.672815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4168c3a0-1655-4010-9617-299067e92efe tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:45.673511 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4168c3a0-1655-4010-9617-299067e92efe tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:45.674003 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4168c3a0-1655-4010-9617-299067e92efe tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:45.674431 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4168c3a0-1655-4010-9617-299067e92efe tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:45.907129 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4168c3a0-1655-4010-9617-299067e92efe tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:45.915692 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-4168c3a0-1655-4010-9617-299067e92efe tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1758 microversion: 2.1 time: 0.255422 Aug 09 18:24:45.930074 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 429/833] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:45 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1758 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:46.505979 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-1d674678-373d-415b-a8fc-2b18994fbb28 req-5044c85e-3d87-40e8-986e-3e7781c9de9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2380477-dae7-428a-a5ba-ee0b14d8e91e", "tag": "057b2422-5227-4c13-8c4d-5c89abcdb889"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:24:46.515336 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-1d674678-373d-415b-a8fc-2b18994fbb28 req-5044c85e-3d87-40e8-986e-3e7781c9de9c service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:46.515817 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-1d674678-373d-415b-a8fc-2b18994fbb28 req-5044c85e-3d87-40e8-986e-3e7781c9de9c service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:46.516241 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-1d674678-373d-415b-a8fc-2b18994fbb28 req-5044c85e-3d87-40e8-986e-3e7781c9de9c service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:46.528136 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-1d674678-373d-415b-a8fc-2b18994fbb28 req-5044c85e-3d87-40e8-986e-3e7781c9de9c service nova] Creating event network-changed:057b2422-5227-4c13-8c4d-5c89abcdb889 for instance b2380477-dae7-428a-a5ba-ee0b14d8e91e on hv-cinder-79797 Aug 09 18:24:46.533349 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-1d674678-373d-415b-a8fc-2b18994fbb28 req-5044c85e-3d87-40e8-986e-3e7781c9de9c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031476 Aug 09 18:24:46.533959 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 405/834] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:24:46.937625 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-91eaea3e-9fbe-433f-bc54-0a765b9e8250 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:46.938518 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-91eaea3e-9fbe-433f-bc54-0a765b9e8250 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:46.946317 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-91eaea3e-9fbe-433f-bc54-0a765b9e8250 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:46.947526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-91eaea3e-9fbe-433f-bc54-0a765b9e8250 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:46.948060 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-91eaea3e-9fbe-433f-bc54-0a765b9e8250 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:46.948870 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-91eaea3e-9fbe-433f-bc54-0a765b9e8250 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:46.949428 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-91eaea3e-9fbe-433f-bc54-0a765b9e8250 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:46.949956 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-91eaea3e-9fbe-433f-bc54-0a765b9e8250 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:47.111147 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-91eaea3e-9fbe-433f-bc54-0a765b9e8250 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:47.120988 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-91eaea3e-9fbe-433f-bc54-0a765b9e8250 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1761 microversion: 2.1 time: 0.186658 Aug 09 18:24:47.134886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 430/835] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:46 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1761 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:47.900458 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-2beba5ec-6094-4366-a2b8-dd1893d26b04 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:47.901034 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-2beba5ec-6094-4366-a2b8-dd1893d26b04 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:47.906998 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2beba5ec-6094-4366-a2b8-dd1893d26b04 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:47.907483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2beba5ec-6094-4366-a2b8-dd1893d26b04 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:47.907913 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2beba5ec-6094-4366-a2b8-dd1893d26b04 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:47.908593 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2beba5ec-6094-4366-a2b8-dd1893d26b04 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:47.909042 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2beba5ec-6094-4366-a2b8-dd1893d26b04 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:47.909462 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2beba5ec-6094-4366-a2b8-dd1893d26b04 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:47.934805 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-2beba5ec-6094-4366-a2b8-dd1893d26b04 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21/ips" status: 200 len: 152 microversion: 2.20 time: 0.040200 Aug 09 18:24:47.935381 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 406/836] 10.222.0.36 () {60 vars in 1289 bytes} [Tue Aug 9 18:24:47 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:24:51.157635 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b3da027c-f7d8-44e5-84af-34d226f7bb14 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:24:51.158138 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-b3da027c-f7d8-44e5-84af-34d226f7bb14 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:51.165335 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b3da027c-f7d8-44e5-84af-34d226f7bb14 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:51.165824 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b3da027c-f7d8-44e5-84af-34d226f7bb14 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:51.166258 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b3da027c-f7d8-44e5-84af-34d226f7bb14 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:51.166973 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b3da027c-f7d8-44e5-84af-34d226f7bb14 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:51.167427 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b3da027c-f7d8-44e5-84af-34d226f7bb14 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:51.167845 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b3da027c-f7d8-44e5-84af-34d226f7bb14 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:51.190645 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.objects.instance [None req-b3da027c-f7d8-44e5-84af-34d226f7bb14 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lazy-loading 'flavor' on Instance uuid 262e54dc-8819-4689-ad3a-577f966f5a21 {{(pid=118313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:24:51.641502 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b3da027c-f7d8-44e5-84af-34d226f7bb14 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "POST /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21/action" status: 202 len: 0 microversion: 2.20 time: 0.487737 Aug 09 18:24:51.642085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 431/837] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Aug 9 18:24:51 2022] POST /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:24:51.651635 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-2f5fa2d5-ba4c-44d5-9dff-74ac8223bb72 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:51.652253 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-2f5fa2d5-ba4c-44d5-9dff-74ac8223bb72 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:51.658610 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2f5fa2d5-ba4c-44d5-9dff-74ac8223bb72 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:51.659194 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2f5fa2d5-ba4c-44d5-9dff-74ac8223bb72 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:51.659622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2f5fa2d5-ba4c-44d5-9dff-74ac8223bb72 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:51.660358 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2f5fa2d5-ba4c-44d5-9dff-74ac8223bb72 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:51.660751 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2f5fa2d5-ba4c-44d5-9dff-74ac8223bb72 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:51.661169 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2f5fa2d5-ba4c-44d5-9dff-74ac8223bb72 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:51.682429 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=100 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:24:51.832047 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-2f5fa2d5-ba4c-44d5-9dff-74ac8223bb72 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:51.839536 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-2f5fa2d5-ba4c-44d5-9dff-74ac8223bb72 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:51.841026 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-2f5fa2d5-ba4c-44d5-9dff-74ac8223bb72 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:51.842190 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-2f5fa2d5-ba4c-44d5-9dff-74ac8223bb72 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1723 microversion: 2.20 time: 0.195772 Aug 09 18:24:51.842761 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 407/838] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:24:51 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:24:52.866346 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a27517e9-d51a-4de9-bdad-5b912d3b3685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:52.867225 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a27517e9-d51a-4de9-bdad-5b912d3b3685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:52.873913 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a27517e9-d51a-4de9-bdad-5b912d3b3685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:52.874399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a27517e9-d51a-4de9-bdad-5b912d3b3685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:52.874864 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a27517e9-d51a-4de9-bdad-5b912d3b3685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:52.875556 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a27517e9-d51a-4de9-bdad-5b912d3b3685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:52.876020 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a27517e9-d51a-4de9-bdad-5b912d3b3685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:52.876437 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a27517e9-d51a-4de9-bdad-5b912d3b3685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:53.033000 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a27517e9-d51a-4de9-bdad-5b912d3b3685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:53.039795 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a27517e9-d51a-4de9-bdad-5b912d3b3685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:53.041385 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a27517e9-d51a-4de9-bdad-5b912d3b3685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:53.042491 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a27517e9-d51a-4de9-bdad-5b912d3b3685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1723 microversion: 2.20 time: 0.180644 Aug 09 18:24:53.043072 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 432/839] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:24:52 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:24:54.065490 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-6c2d28de-5143-4763-8de5-5dff0c0f38f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:54.066154 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-6c2d28de-5143-4763-8de5-5dff0c0f38f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:54.073089 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6c2d28de-5143-4763-8de5-5dff0c0f38f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:54.077865 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6c2d28de-5143-4763-8de5-5dff0c0f38f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:54.077865 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6c2d28de-5143-4763-8de5-5dff0c0f38f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:54.077865 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6c2d28de-5143-4763-8de5-5dff0c0f38f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:54.077865 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6c2d28de-5143-4763-8de5-5dff0c0f38f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:54.078334 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6c2d28de-5143-4763-8de5-5dff0c0f38f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:54.216413 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-6c2d28de-5143-4763-8de5-5dff0c0f38f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:54.234055 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-6c2d28de-5143-4763-8de5-5dff0c0f38f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:54.234055 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-6c2d28de-5143-4763-8de5-5dff0c0f38f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:54.234055 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-6c2d28de-5143-4763-8de5-5dff0c0f38f0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1723 microversion: 2.20 time: 0.166389 Aug 09 18:24:54.234494 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 408/840] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:24:54 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:24:55.251325 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b5098247-9ff6-4bd1-8a80-3197916c1bb4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:55.251935 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-b5098247-9ff6-4bd1-8a80-3197916c1bb4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:55.254439 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:24:55.259798 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b5098247-9ff6-4bd1-8a80-3197916c1bb4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:55.261071 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b5098247-9ff6-4bd1-8a80-3197916c1bb4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:55.261071 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b5098247-9ff6-4bd1-8a80-3197916c1bb4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:55.261524 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b5098247-9ff6-4bd1-8a80-3197916c1bb4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:55.261986 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b5098247-9ff6-4bd1-8a80-3197916c1bb4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:55.262408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b5098247-9ff6-4bd1-8a80-3197916c1bb4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:55.401172 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b5098247-9ff6-4bd1-8a80-3197916c1bb4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:55.408978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b5098247-9ff6-4bd1-8a80-3197916c1bb4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:55.410556 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b5098247-9ff6-4bd1-8a80-3197916c1bb4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:55.411726 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b5098247-9ff6-4bd1-8a80-3197916c1bb4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1723 microversion: 2.20 time: 0.164259 Aug 09 18:24:55.412286 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 433/841] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:24:55 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:24:56.434466 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-924c6bdf-32e9-4c3b-bcd0-65e029b382a0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:56.435105 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-924c6bdf-32e9-4c3b-bcd0-65e029b382a0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:56.437008 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:24:56.441622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-924c6bdf-32e9-4c3b-bcd0-65e029b382a0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:56.442150 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-924c6bdf-32e9-4c3b-bcd0-65e029b382a0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:56.442586 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-924c6bdf-32e9-4c3b-bcd0-65e029b382a0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:56.443314 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-924c6bdf-32e9-4c3b-bcd0-65e029b382a0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:56.443771 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-924c6bdf-32e9-4c3b-bcd0-65e029b382a0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:56.444686 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-924c6bdf-32e9-4c3b-bcd0-65e029b382a0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:56.583508 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-924c6bdf-32e9-4c3b-bcd0-65e029b382a0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:56.592332 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-924c6bdf-32e9-4c3b-bcd0-65e029b382a0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:56.593858 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-924c6bdf-32e9-4c3b-bcd0-65e029b382a0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:56.595079 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-924c6bdf-32e9-4c3b-bcd0-65e029b382a0 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1723 microversion: 2.20 time: 0.164611 Aug 09 18:24:56.595634 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 409/842] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:24:56 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:24:57.620103 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-121c0556-7422-451d-ba44-824cd1066c05 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:57.621168 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-121c0556-7422-451d-ba44-824cd1066c05 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:57.627951 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-121c0556-7422-451d-ba44-824cd1066c05 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:57.628451 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-121c0556-7422-451d-ba44-824cd1066c05 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:57.628945 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-121c0556-7422-451d-ba44-824cd1066c05 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:57.629653 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-121c0556-7422-451d-ba44-824cd1066c05 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:57.630111 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-121c0556-7422-451d-ba44-824cd1066c05 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:57.630542 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-121c0556-7422-451d-ba44-824cd1066c05 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:57.777674 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-121c0556-7422-451d-ba44-824cd1066c05 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:57.786439 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-121c0556-7422-451d-ba44-824cd1066c05 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:57.788600 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-121c0556-7422-451d-ba44-824cd1066c05 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:57.789820 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-121c0556-7422-451d-ba44-824cd1066c05 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1723 microversion: 2.20 time: 0.175466 Aug 09 18:24:57.790387 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 434/843] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:24:57 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:24:58.812339 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c6b448e5-fc52-411a-9172-20db79ea6bfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:58.812964 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c6b448e5-fc52-411a-9172-20db79ea6bfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:58.820749 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c6b448e5-fc52-411a-9172-20db79ea6bfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:58.820914 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c6b448e5-fc52-411a-9172-20db79ea6bfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:58.821352 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c6b448e5-fc52-411a-9172-20db79ea6bfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:58.822055 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c6b448e5-fc52-411a-9172-20db79ea6bfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:58.822512 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c6b448e5-fc52-411a-9172-20db79ea6bfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:58.822970 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c6b448e5-fc52-411a-9172-20db79ea6bfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:58.969367 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c6b448e5-fc52-411a-9172-20db79ea6bfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:58.977616 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c6b448e5-fc52-411a-9172-20db79ea6bfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:58.979132 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c6b448e5-fc52-411a-9172-20db79ea6bfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:58.980336 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c6b448e5-fc52-411a-9172-20db79ea6bfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1723 microversion: 2.20 time: 0.171854 Aug 09 18:24:58.980832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 410/844] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:24:58 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:00.002518 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-eb635874-2cc5-4a18-9db7-60f96cae42bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:00.003290 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-eb635874-2cc5-4a18-9db7-60f96cae42bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:00.010246 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eb635874-2cc5-4a18-9db7-60f96cae42bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:00.010746 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eb635874-2cc5-4a18-9db7-60f96cae42bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:00.011184 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eb635874-2cc5-4a18-9db7-60f96cae42bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:00.011865 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eb635874-2cc5-4a18-9db7-60f96cae42bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:00.012312 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eb635874-2cc5-4a18-9db7-60f96cae42bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:00.012731 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eb635874-2cc5-4a18-9db7-60f96cae42bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:00.141936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-eb635874-2cc5-4a18-9db7-60f96cae42bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:00.150157 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-eb635874-2cc5-4a18-9db7-60f96cae42bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:00.151714 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-eb635874-2cc5-4a18-9db7-60f96cae42bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:00.152902 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-eb635874-2cc5-4a18-9db7-60f96cae42bf tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1723 microversion: 2.20 time: 0.154334 Aug 09 18:25:00.153485 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 435/845] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:24:59 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:01.177318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-59850026-552a-483a-8ed2-641f8f80e050 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:01.177842 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-59850026-552a-483a-8ed2-641f8f80e050 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:01.184335 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-59850026-552a-483a-8ed2-641f8f80e050 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:01.184838 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-59850026-552a-483a-8ed2-641f8f80e050 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:01.185258 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-59850026-552a-483a-8ed2-641f8f80e050 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:01.185948 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-59850026-552a-483a-8ed2-641f8f80e050 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:01.186401 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-59850026-552a-483a-8ed2-641f8f80e050 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:01.186848 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-59850026-552a-483a-8ed2-641f8f80e050 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:01.320641 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-59850026-552a-483a-8ed2-641f8f80e050 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:01.329448 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-59850026-552a-483a-8ed2-641f8f80e050 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:01.330999 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-59850026-552a-483a-8ed2-641f8f80e050 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:01.332223 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-59850026-552a-483a-8ed2-641f8f80e050 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1723 microversion: 2.20 time: 0.158996 Aug 09 18:25:01.332789 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 411/846] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:01 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:02.355948 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-56c20307-2b10-4c18-89ef-542a4dece6c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:02.356487 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-56c20307-2b10-4c18-89ef-542a4dece6c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:02.363166 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-56c20307-2b10-4c18-89ef-542a4dece6c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:02.363648 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-56c20307-2b10-4c18-89ef-542a4dece6c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:02.364086 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-56c20307-2b10-4c18-89ef-542a4dece6c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:02.364782 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-56c20307-2b10-4c18-89ef-542a4dece6c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:02.365235 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-56c20307-2b10-4c18-89ef-542a4dece6c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:02.365659 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-56c20307-2b10-4c18-89ef-542a4dece6c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:02.497472 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-56c20307-2b10-4c18-89ef-542a4dece6c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:02.505302 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-56c20307-2b10-4c18-89ef-542a4dece6c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:02.506819 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-56c20307-2b10-4c18-89ef-542a4dece6c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:02.507974 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-56c20307-2b10-4c18-89ef-542a4dece6c7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1723 microversion: 2.20 time: 0.156728 Aug 09 18:25:02.508529 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 436/847] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:02 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:25:03.531660 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d4cc5fb1-75f2-4d66-b4a7-cd4c9f469b42 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:03.532348 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d4cc5fb1-75f2-4d66-b4a7-cd4c9f469b42 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:03.539152 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d4cc5fb1-75f2-4d66-b4a7-cd4c9f469b42 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:03.539366 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d4cc5fb1-75f2-4d66-b4a7-cd4c9f469b42 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:03.539797 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d4cc5fb1-75f2-4d66-b4a7-cd4c9f469b42 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:03.540522 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d4cc5fb1-75f2-4d66-b4a7-cd4c9f469b42 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:03.540973 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d4cc5fb1-75f2-4d66-b4a7-cd4c9f469b42 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:03.541390 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d4cc5fb1-75f2-4d66-b4a7-cd4c9f469b42 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:03.680171 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d4cc5fb1-75f2-4d66-b4a7-cd4c9f469b42 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:03.688062 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d4cc5fb1-75f2-4d66-b4a7-cd4c9f469b42 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:03.689597 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d4cc5fb1-75f2-4d66-b4a7-cd4c9f469b42 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:03.690768 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d4cc5fb1-75f2-4d66-b4a7-cd4c9f469b42 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1744 microversion: 2.20 time: 0.163035 Aug 09 18:25:03.691325 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 412/848] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:03 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:25:04.714351 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-dbd31f8e-c192-4a54-9cc4-ca8fc638a5ad tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:04.715532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-dbd31f8e-c192-4a54-9cc4-ca8fc638a5ad tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:04.721952 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dbd31f8e-c192-4a54-9cc4-ca8fc638a5ad tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:04.722436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dbd31f8e-c192-4a54-9cc4-ca8fc638a5ad tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:04.722921 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dbd31f8e-c192-4a54-9cc4-ca8fc638a5ad tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:04.723612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dbd31f8e-c192-4a54-9cc4-ca8fc638a5ad tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:04.724070 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dbd31f8e-c192-4a54-9cc4-ca8fc638a5ad tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:04.724493 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dbd31f8e-c192-4a54-9cc4-ca8fc638a5ad tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:04.856603 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-dbd31f8e-c192-4a54-9cc4-ca8fc638a5ad tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:04.864926 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-dbd31f8e-c192-4a54-9cc4-ca8fc638a5ad tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:04.866428 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-dbd31f8e-c192-4a54-9cc4-ca8fc638a5ad tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:04.867618 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-dbd31f8e-c192-4a54-9cc4-ca8fc638a5ad tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1744 microversion: 2.20 time: 0.157327 Aug 09 18:25:04.868182 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 437/849] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:04 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:05.892404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-6a6665c6-399b-4981-bea6-d104846aae78 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:05.893151 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-6a6665c6-399b-4981-bea6-d104846aae78 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:05.899875 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6a6665c6-399b-4981-bea6-d104846aae78 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:05.900387 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6a6665c6-399b-4981-bea6-d104846aae78 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:05.900810 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6a6665c6-399b-4981-bea6-d104846aae78 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:05.901525 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6a6665c6-399b-4981-bea6-d104846aae78 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:05.902001 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6a6665c6-399b-4981-bea6-d104846aae78 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:05.902411 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6a6665c6-399b-4981-bea6-d104846aae78 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:06.035674 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-6a6665c6-399b-4981-bea6-d104846aae78 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:06.043733 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-6a6665c6-399b-4981-bea6-d104846aae78 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:06.045274 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-6a6665c6-399b-4981-bea6-d104846aae78 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:06.046419 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-6a6665c6-399b-4981-bea6-d104846aae78 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1744 microversion: 2.20 time: 0.158352 Aug 09 18:25:06.047004 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 413/850] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:05 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:07.069844 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f5211ef1-6d71-4369-acbc-731c5ebb909a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:07.070490 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f5211ef1-6d71-4369-acbc-731c5ebb909a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:07.080190 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f5211ef1-6d71-4369-acbc-731c5ebb909a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:07.080190 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f5211ef1-6d71-4369-acbc-731c5ebb909a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:07.080190 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f5211ef1-6d71-4369-acbc-731c5ebb909a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:07.080190 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f5211ef1-6d71-4369-acbc-731c5ebb909a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:07.080571 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f5211ef1-6d71-4369-acbc-731c5ebb909a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:07.080571 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f5211ef1-6d71-4369-acbc-731c5ebb909a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:07.218424 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f5211ef1-6d71-4369-acbc-731c5ebb909a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:07.226483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f5211ef1-6d71-4369-acbc-731c5ebb909a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:07.228036 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f5211ef1-6d71-4369-acbc-731c5ebb909a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:07.229193 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f5211ef1-6d71-4369-acbc-731c5ebb909a tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1744 microversion: 2.20 time: 0.163496 Aug 09 18:25:07.229751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 438/851] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:07 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:08.253108 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-1c0682a4-798e-4e80-adcd-3e92a5898528 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:08.253774 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-1c0682a4-798e-4e80-adcd-3e92a5898528 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:08.260195 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1c0682a4-798e-4e80-adcd-3e92a5898528 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:08.260684 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1c0682a4-798e-4e80-adcd-3e92a5898528 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:08.261124 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1c0682a4-798e-4e80-adcd-3e92a5898528 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:08.261824 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1c0682a4-798e-4e80-adcd-3e92a5898528 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:08.262969 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1c0682a4-798e-4e80-adcd-3e92a5898528 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:08.263478 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1c0682a4-798e-4e80-adcd-3e92a5898528 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:08.398226 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-1c0682a4-798e-4e80-adcd-3e92a5898528 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:08.407946 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-1c0682a4-798e-4e80-adcd-3e92a5898528 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:08.409859 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-1c0682a4-798e-4e80-adcd-3e92a5898528 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:08.411308 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-1c0682a4-798e-4e80-adcd-3e92a5898528 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1744 microversion: 2.20 time: 0.162090 Aug 09 18:25:08.411971 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 414/852] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:08 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:08.444325 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-66bf9270-4f69-4756-819b-dd0e9379fa43 req-bac4f8f6-34ec-449f-9b7c-061d4f36bc43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262e54dc-8819-4689-ad3a-577f966f5a21", "name": "network-vif-plugged", "status": "completed", "tag": "0326ddaa-6e24-40bf-9ac7-991d3e2669c4"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:25:08.455402 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-66bf9270-4f69-4756-819b-dd0e9379fa43 req-bac4f8f6-34ec-449f-9b7c-061d4f36bc43 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:08.456089 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-66bf9270-4f69-4756-819b-dd0e9379fa43 req-bac4f8f6-34ec-449f-9b7c-061d4f36bc43 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:08.456695 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-66bf9270-4f69-4756-819b-dd0e9379fa43 req-bac4f8f6-34ec-449f-9b7c-061d4f36bc43 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:08.469407 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-66bf9270-4f69-4756-819b-dd0e9379fa43 req-bac4f8f6-34ec-449f-9b7c-061d4f36bc43 service nova] Creating event network-vif-plugged:0326ddaa-6e24-40bf-9ac7-991d3e2669c4 for instance 262e54dc-8819-4689-ad3a-577f966f5a21 on hv-cinder-79797 Aug 09 18:25:08.473885 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-66bf9270-4f69-4756-819b-dd0e9379fa43 req-bac4f8f6-34ec-449f-9b7c-061d4f36bc43 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034428 Aug 09 18:25:08.474526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 439/853] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:25:09.434672 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-832e2ded-1b47-4368-8682-9d8d21c2c4be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:09.435418 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-832e2ded-1b47-4368-8682-9d8d21c2c4be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:09.441651 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-832e2ded-1b47-4368-8682-9d8d21c2c4be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:09.442127 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-832e2ded-1b47-4368-8682-9d8d21c2c4be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:09.442556 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-832e2ded-1b47-4368-8682-9d8d21c2c4be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:09.444499 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-832e2ded-1b47-4368-8682-9d8d21c2c4be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:09.444499 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-832e2ded-1b47-4368-8682-9d8d21c2c4be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:09.444499 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-832e2ded-1b47-4368-8682-9d8d21c2c4be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:09.580147 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-832e2ded-1b47-4368-8682-9d8d21c2c4be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:09.588210 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-832e2ded-1b47-4368-8682-9d8d21c2c4be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:09.589772 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-832e2ded-1b47-4368-8682-9d8d21c2c4be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:09.590967 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-832e2ded-1b47-4368-8682-9d8d21c2c4be tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1744 microversion: 2.20 time: 0.160713 Aug 09 18:25:09.591820 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 415/854] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:09 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:10.618289 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-00abf50a-2137-4cef-b313-bd9ab3db2e36 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:10.619720 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-00abf50a-2137-4cef-b313-bd9ab3db2e36 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:10.627619 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-00abf50a-2137-4cef-b313-bd9ab3db2e36 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:10.628124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-00abf50a-2137-4cef-b313-bd9ab3db2e36 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:10.628567 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-00abf50a-2137-4cef-b313-bd9ab3db2e36 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:10.629282 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-00abf50a-2137-4cef-b313-bd9ab3db2e36 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:10.629740 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-00abf50a-2137-4cef-b313-bd9ab3db2e36 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:10.630167 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-00abf50a-2137-4cef-b313-bd9ab3db2e36 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:10.650395 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:25:10.650874 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e81d11e9-0ae7-467d-a1b7-32206e8925e3 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-689949273", "imageRef": "53732c26-c942-4646-ac3f-8d9e11ab4d57", "flavorRef": "452"}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:25:10.714577 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.network.neutron [None req-e81d11e9-0ae7-467d-a1b7-32206e8925e3 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] validate_networks() for None {{(pid=118314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:25:10.896068 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-00abf50a-2137-4cef-b313-bd9ab3db2e36 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:10.908910 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-00abf50a-2137-4cef-b313-bd9ab3db2e36 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:10.911314 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-00abf50a-2137-4cef-b313-bd9ab3db2e36 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:10.913551 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-00abf50a-2137-4cef-b313-bd9ab3db2e36 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1739 microversion: 2.20 time: 0.302588 Aug 09 18:25:10.928231 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 440/855] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:10 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1739 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:11.064550 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-e81d11e9-0ae7-467d-a1b7-32206e8925e3 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Flavor limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:25:11.065261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-e81d11e9-0ae7-467d-a1b7-32206e8925e3 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Image limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:25:11.065889 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-e81d11e9-0ae7-467d-a1b7-32206e8925e3 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Flavor pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:25:11.066498 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-e81d11e9-0ae7-467d-a1b7-32206e8925e3 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Image pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:25:11.066933 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-e81d11e9-0ae7-467d-a1b7-32206e8925e3 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:25:11.076668 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e81d11e9-0ae7-467d-a1b7-32206e8925e3 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:11.077216 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e81d11e9-0ae7-467d-a1b7-32206e8925e3 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:11.077740 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e81d11e9-0ae7-467d-a1b7-32206e8925e3 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:11.078465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e81d11e9-0ae7-467d-a1b7-32206e8925e3 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:11.078985 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e81d11e9-0ae7-467d-a1b7-32206e8925e3 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:11.079413 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-e81d11e9-0ae7-467d-a1b7-32206e8925e3 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:11.097473 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-e81d11e9-0ae7-467d-a1b7-32206e8925e3 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Getting quotas for project eb3aa9fd0a124dfe822a66f424969beb. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:25:11.104177 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-e81d11e9-0ae7-467d-a1b7-32206e8925e3 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Getting quotas for user 6013ed73af5b463b9a485a9a57e172b4 and project eb3aa9fd0a124dfe822a66f424969beb. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:25:11.122573 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e81d11e9-0ae7-467d-a1b7-32206e8925e3 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Going to run 1 instances... {{(pid=118314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:25:11.125006 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-e81d11e9-0ae7-467d-a1b7-32206e8925e3 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] [instance: 317e309c-4c25-4ff8-90d9-10ade4cf06fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53732c26-c942-4646-ac3f-8d9e11ab4d57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:25:11.242661 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e81d11e9-0ae7-467d-a1b7-32206e8925e3 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595721 Aug 09 18:25:11.243376 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 416/856] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Aug 9 18:25:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:25:11.255892 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6f038a7f-d8d7-43a8-ae7f-4f10ff055664 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:11.256679 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-6f038a7f-d8d7-43a8-ae7f-4f10ff055664 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] [instance: 317e309c-4c25-4ff8-90d9-10ade4cf06fb] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:11.326128 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6f038a7f-d8d7-43a8-ae7f-4f10ff055664 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6013ed73af5b463b9a485a9a57e172b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3aa9fd0a124dfe822a66f424969beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:11.334053 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-6f038a7f-d8d7-43a8-ae7f-4f10ff055664 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] 10.222.0.36 "GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb" status: 200 len: 1214 microversion: 2.1 time: 0.082583 Aug 09 18:25:11.334958 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 441/857] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:11 2022] GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:25:11.949439 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-3e4ff079-fcde-46ec-b9f1-6f3633df2fb7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:11.952110 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-3e4ff079-fcde-46ec-b9f1-6f3633df2fb7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:11.967663 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3e4ff079-fcde-46ec-b9f1-6f3633df2fb7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:11.969701 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3e4ff079-fcde-46ec-b9f1-6f3633df2fb7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:11.971213 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3e4ff079-fcde-46ec-b9f1-6f3633df2fb7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:11.972675 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3e4ff079-fcde-46ec-b9f1-6f3633df2fb7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:11.973374 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3e4ff079-fcde-46ec-b9f1-6f3633df2fb7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:11.973994 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3e4ff079-fcde-46ec-b9f1-6f3633df2fb7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:12.138099 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-3e4ff079-fcde-46ec-b9f1-6f3633df2fb7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:12.151309 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-3e4ff079-fcde-46ec-b9f1-6f3633df2fb7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:12.153966 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-3e4ff079-fcde-46ec-b9f1-6f3633df2fb7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:12.155456 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-3e4ff079-fcde-46ec-b9f1-6f3633df2fb7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1739 microversion: 2.20 time: 0.216135 Aug 09 18:25:12.160572 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 417/858] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:11 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:12.369167 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f8cfa4d2-6fd1-40fc-8bb3-4b714fed4076 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:12.374270 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f8cfa4d2-6fd1-40fc-8bb3-4b714fed4076 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] [instance: 317e309c-4c25-4ff8-90d9-10ade4cf06fb] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:12.448019 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f8cfa4d2-6fd1-40fc-8bb3-4b714fed4076 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6013ed73af5b463b9a485a9a57e172b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3aa9fd0a124dfe822a66f424969beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:12.458866 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f8cfa4d2-6fd1-40fc-8bb3-4b714fed4076 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] 10.222.0.36 "GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb" status: 200 len: 1214 microversion: 2.1 time: 0.096997 Aug 09 18:25:12.460133 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 442/859] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:12 2022] GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:25:13.182014 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-20e67b13-3f1e-4c1b-8fb0-8425500b00a9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:13.183266 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-20e67b13-3f1e-4c1b-8fb0-8425500b00a9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:13.202540 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-20e67b13-3f1e-4c1b-8fb0-8425500b00a9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:13.203418 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-20e67b13-3f1e-4c1b-8fb0-8425500b00a9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:13.203985 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-20e67b13-3f1e-4c1b-8fb0-8425500b00a9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:13.205360 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-20e67b13-3f1e-4c1b-8fb0-8425500b00a9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:13.206499 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-20e67b13-3f1e-4c1b-8fb0-8425500b00a9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:13.207617 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-20e67b13-3f1e-4c1b-8fb0-8425500b00a9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:13.353205 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-20e67b13-3f1e-4c1b-8fb0-8425500b00a9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:13.365433 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-20e67b13-3f1e-4c1b-8fb0-8425500b00a9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:13.368281 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-20e67b13-3f1e-4c1b-8fb0-8425500b00a9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:13.369457 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-20e67b13-3f1e-4c1b-8fb0-8425500b00a9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1739 microversion: 2.20 time: 0.192245 Aug 09 18:25:13.370016 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 418/860] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:13 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:13.490631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f799679f-417a-4fc2-83a8-eff7a2e39641 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:13.492615 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f799679f-417a-4fc2-83a8-eff7a2e39641 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] [instance: 317e309c-4c25-4ff8-90d9-10ade4cf06fb] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:13.501548 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f799679f-417a-4fc2-83a8-eff7a2e39641 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:13.502637 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f799679f-417a-4fc2-83a8-eff7a2e39641 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:13.503489 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f799679f-417a-4fc2-83a8-eff7a2e39641 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:13.503904 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f799679f-417a-4fc2-83a8-eff7a2e39641 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:13.504455 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f799679f-417a-4fc2-83a8-eff7a2e39641 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:13.504890 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f799679f-417a-4fc2-83a8-eff7a2e39641 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:13.595714 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f799679f-417a-4fc2-83a8-eff7a2e39641 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6013ed73af5b463b9a485a9a57e172b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3aa9fd0a124dfe822a66f424969beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:13.606863 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f799679f-417a-4fc2-83a8-eff7a2e39641 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] 10.222.0.36 "GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb" status: 200 len: 1266 microversion: 2.1 time: 0.120501 Aug 09 18:25:13.607639 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 443/861] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:13 2022] GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb => generated 1266 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:25:14.396027 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-4cc39a3d-3ec4-478d-ab6d-219a652ab8bc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:14.396977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-4cc39a3d-3ec4-478d-ab6d-219a652ab8bc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:14.408193 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4cc39a3d-3ec4-478d-ab6d-219a652ab8bc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:14.408695 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4cc39a3d-3ec4-478d-ab6d-219a652ab8bc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:14.409133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4cc39a3d-3ec4-478d-ab6d-219a652ab8bc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:14.409871 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4cc39a3d-3ec4-478d-ab6d-219a652ab8bc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:14.410319 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4cc39a3d-3ec4-478d-ab6d-219a652ab8bc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:14.412936 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4cc39a3d-3ec4-478d-ab6d-219a652ab8bc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:14.601033 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-4cc39a3d-3ec4-478d-ab6d-219a652ab8bc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:14.613715 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-4cc39a3d-3ec4-478d-ab6d-219a652ab8bc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:14.617305 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-4cc39a3d-3ec4-478d-ab6d-219a652ab8bc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:14.620639 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-4cc39a3d-3ec4-478d-ab6d-219a652ab8bc tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1739 microversion: 2.20 time: 0.229438 Aug 09 18:25:14.623782 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 419/862] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:14 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:14.629942 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-cc385ad2-5fc9-480f-ab61-a1a53398e092 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:14.630773 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-cc385ad2-5fc9-480f-ab61-a1a53398e092 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] [instance: 317e309c-4c25-4ff8-90d9-10ade4cf06fb] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:14.640001 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc385ad2-5fc9-480f-ab61-a1a53398e092 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:14.640498 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc385ad2-5fc9-480f-ab61-a1a53398e092 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:14.641242 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc385ad2-5fc9-480f-ab61-a1a53398e092 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:14.641915 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc385ad2-5fc9-480f-ab61-a1a53398e092 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:14.642445 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc385ad2-5fc9-480f-ab61-a1a53398e092 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:14.643103 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cc385ad2-5fc9-480f-ab61-a1a53398e092 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:14.711309 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-cc385ad2-5fc9-480f-ab61-a1a53398e092 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6013ed73af5b463b9a485a9a57e172b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3aa9fd0a124dfe822a66f424969beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:14.720591 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-cc385ad2-5fc9-480f-ab61-a1a53398e092 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] 10.222.0.36 "GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb" status: 200 len: 1272 microversion: 2.1 time: 0.094191 Aug 09 18:25:14.720846 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 444/863] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:14 2022] GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb => generated 1272 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:25:15.646842 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d2068efd-d8ec-40cd-bba9-5b2169075df4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:15.647599 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d2068efd-d8ec-40cd-bba9-5b2169075df4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:15.655952 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d2068efd-d8ec-40cd-bba9-5b2169075df4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:15.656783 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d2068efd-d8ec-40cd-bba9-5b2169075df4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:15.657053 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d2068efd-d8ec-40cd-bba9-5b2169075df4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:15.657768 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d2068efd-d8ec-40cd-bba9-5b2169075df4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:15.658356 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d2068efd-d8ec-40cd-bba9-5b2169075df4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:15.658874 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d2068efd-d8ec-40cd-bba9-5b2169075df4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:15.742380 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-1a229e12-6c25-424c-bba9-c6bccde9c370 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:15.743735 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-1a229e12-6c25-424c-bba9-c6bccde9c370 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] [instance: 317e309c-4c25-4ff8-90d9-10ade4cf06fb] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:15.763500 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1a229e12-6c25-424c-bba9-c6bccde9c370 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:15.764037 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1a229e12-6c25-424c-bba9-c6bccde9c370 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:15.764504 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1a229e12-6c25-424c-bba9-c6bccde9c370 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:15.765271 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1a229e12-6c25-424c-bba9-c6bccde9c370 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:15.765732 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1a229e12-6c25-424c-bba9-c6bccde9c370 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:15.767620 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1a229e12-6c25-424c-bba9-c6bccde9c370 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:15.819046 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d2068efd-d8ec-40cd-bba9-5b2169075df4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:15.836175 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d2068efd-d8ec-40cd-bba9-5b2169075df4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:15.838921 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d2068efd-d8ec-40cd-bba9-5b2169075df4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:15.840376 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d2068efd-d8ec-40cd-bba9-5b2169075df4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1739 microversion: 2.20 time: 0.197617 Aug 09 18:25:15.841264 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 420/864] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:15 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:15.933775 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-1a229e12-6c25-424c-bba9-c6bccde9c370 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6013ed73af5b463b9a485a9a57e172b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3aa9fd0a124dfe822a66f424969beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:15.943958 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-1a229e12-6c25-424c-bba9-c6bccde9c370 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] 10.222.0.36 "GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb" status: 200 len: 1314 microversion: 2.1 time: 0.206075 Aug 09 18:25:15.945213 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 445/865] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:15 2022] GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:16.055841 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-d54ea392-4efd-4676-920c-2b315c9e5411 req-858f1549-d7bd-4b68-a215-3ec1ebde3d33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317e309c-4c25-4ff8-90d9-10ade4cf06fb", "tag": "f654232c-51d7-4940-822d-8f227ee7d403"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:25:16.066526 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-d54ea392-4efd-4676-920c-2b315c9e5411 req-858f1549-d7bd-4b68-a215-3ec1ebde3d33 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:16.067021 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-d54ea392-4efd-4676-920c-2b315c9e5411 req-858f1549-d7bd-4b68-a215-3ec1ebde3d33 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:16.067459 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-d54ea392-4efd-4676-920c-2b315c9e5411 req-858f1549-d7bd-4b68-a215-3ec1ebde3d33 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:16.079394 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-d54ea392-4efd-4676-920c-2b315c9e5411 req-858f1549-d7bd-4b68-a215-3ec1ebde3d33 service nova] Creating event network-changed:f654232c-51d7-4940-822d-8f227ee7d403 for instance 317e309c-4c25-4ff8-90d9-10ade4cf06fb on hv-cinder-79797 Aug 09 18:25:16.084999 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-d54ea392-4efd-4676-920c-2b315c9e5411 req-858f1549-d7bd-4b68-a215-3ec1ebde3d33 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032604 Aug 09 18:25:16.086160 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 421/866] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:25:16.890649 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2c21d8c6-1135-422d-be3f-7c173b0ee582 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:16.892117 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-2c21d8c6-1135-422d-be3f-7c173b0ee582 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:16.906429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2c21d8c6-1135-422d-be3f-7c173b0ee582 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:16.907168 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2c21d8c6-1135-422d-be3f-7c173b0ee582 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:16.907706 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2c21d8c6-1135-422d-be3f-7c173b0ee582 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:16.908689 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2c21d8c6-1135-422d-be3f-7c173b0ee582 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:16.909218 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2c21d8c6-1135-422d-be3f-7c173b0ee582 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:16.909724 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2c21d8c6-1135-422d-be3f-7c173b0ee582 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:16.966353 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f9edc0b5-2cd8-4aff-836b-4ec26354b34d tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:16.967068 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f9edc0b5-2cd8-4aff-836b-4ec26354b34d tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] [instance: 317e309c-4c25-4ff8-90d9-10ade4cf06fb] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:16.974510 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f9edc0b5-2cd8-4aff-836b-4ec26354b34d tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:16.975276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f9edc0b5-2cd8-4aff-836b-4ec26354b34d tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:16.975711 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f9edc0b5-2cd8-4aff-836b-4ec26354b34d tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:16.976588 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f9edc0b5-2cd8-4aff-836b-4ec26354b34d tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:16.977046 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f9edc0b5-2cd8-4aff-836b-4ec26354b34d tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:16.977467 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f9edc0b5-2cd8-4aff-836b-4ec26354b34d tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:17.100282 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-2c21d8c6-1135-422d-be3f-7c173b0ee582 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:17.110315 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-2c21d8c6-1135-422d-be3f-7c173b0ee582 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:17.112336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-2c21d8c6-1135-422d-be3f-7c173b0ee582 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:17.114634 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-2c21d8c6-1135-422d-be3f-7c173b0ee582 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1739 microversion: 2.20 time: 0.252187 Aug 09 18:25:17.131146 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 446/867] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:16 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1739 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:17.175421 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f9edc0b5-2cd8-4aff-836b-4ec26354b34d tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6013ed73af5b463b9a485a9a57e172b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3aa9fd0a124dfe822a66f424969beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:17.182857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f9edc0b5-2cd8-4aff-836b-4ec26354b34d tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] 10.222.0.36 "GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb" status: 200 len: 1314 microversion: 2.1 time: 0.221201 Aug 09 18:25:17.183421 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 422/868] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:16 2022] GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:25:18.140962 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-90b72c50-d46a-4633-88fd-bfad803de2a7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:18.141653 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-90b72c50-d46a-4633-88fd-bfad803de2a7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:18.150316 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-90b72c50-d46a-4633-88fd-bfad803de2a7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:18.150841 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-90b72c50-d46a-4633-88fd-bfad803de2a7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:18.151282 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-90b72c50-d46a-4633-88fd-bfad803de2a7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:18.151995 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-90b72c50-d46a-4633-88fd-bfad803de2a7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:18.152487 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-90b72c50-d46a-4633-88fd-bfad803de2a7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:18.152911 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-90b72c50-d46a-4633-88fd-bfad803de2a7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:18.205102 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-58ce0bdf-919b-43a1-a414-7c98c5730e42 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:18.205738 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-58ce0bdf-919b-43a1-a414-7c98c5730e42 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] [instance: 317e309c-4c25-4ff8-90d9-10ade4cf06fb] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:18.212469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-58ce0bdf-919b-43a1-a414-7c98c5730e42 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:18.212948 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-58ce0bdf-919b-43a1-a414-7c98c5730e42 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:18.214161 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-58ce0bdf-919b-43a1-a414-7c98c5730e42 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:18.215094 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-58ce0bdf-919b-43a1-a414-7c98c5730e42 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:18.215550 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-58ce0bdf-919b-43a1-a414-7c98c5730e42 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:18.215971 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-58ce0bdf-919b-43a1-a414-7c98c5730e42 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:18.332844 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-90b72c50-d46a-4633-88fd-bfad803de2a7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:18.341895 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-90b72c50-d46a-4633-88fd-bfad803de2a7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:18.345258 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-90b72c50-d46a-4633-88fd-bfad803de2a7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:18.346829 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-90b72c50-d46a-4633-88fd-bfad803de2a7 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1739 microversion: 2.20 time: 0.210483 Aug 09 18:25:18.347850 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 447/869] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:18 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:18.394680 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-58ce0bdf-919b-43a1-a414-7c98c5730e42 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6013ed73af5b463b9a485a9a57e172b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3aa9fd0a124dfe822a66f424969beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:18.402065 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-58ce0bdf-919b-43a1-a414-7c98c5730e42 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] 10.222.0.36 "GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb" status: 200 len: 1314 microversion: 2.1 time: 0.201746 Aug 09 18:25:18.404891 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 423/870] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:18 2022] GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:19.373474 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-83730adf-7ec2-4dc5-896c-ebc2254bb682 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:19.375155 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-83730adf-7ec2-4dc5-896c-ebc2254bb682 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:19.381730 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-83730adf-7ec2-4dc5-896c-ebc2254bb682 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:19.382231 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-83730adf-7ec2-4dc5-896c-ebc2254bb682 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:19.382980 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-83730adf-7ec2-4dc5-896c-ebc2254bb682 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:19.383932 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-83730adf-7ec2-4dc5-896c-ebc2254bb682 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:19.384714 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-83730adf-7ec2-4dc5-896c-ebc2254bb682 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:19.385364 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-83730adf-7ec2-4dc5-896c-ebc2254bb682 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:19.434559 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-eda92ca4-2769-4c26-b939-5e9eaa53107a tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:19.436534 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-eda92ca4-2769-4c26-b939-5e9eaa53107a tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] [instance: 317e309c-4c25-4ff8-90d9-10ade4cf06fb] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:19.454084 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-eda92ca4-2769-4c26-b939-5e9eaa53107a tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:19.458952 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-eda92ca4-2769-4c26-b939-5e9eaa53107a tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:19.459820 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-eda92ca4-2769-4c26-b939-5e9eaa53107a tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:19.460997 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-eda92ca4-2769-4c26-b939-5e9eaa53107a tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:19.461666 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-eda92ca4-2769-4c26-b939-5e9eaa53107a tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:19.468936 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-eda92ca4-2769-4c26-b939-5e9eaa53107a tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:19.680035 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-83730adf-7ec2-4dc5-896c-ebc2254bb682 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:19.689591 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-83730adf-7ec2-4dc5-896c-ebc2254bb682 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:19.693844 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-83730adf-7ec2-4dc5-896c-ebc2254bb682 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:19.694010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-eda92ca4-2769-4c26-b939-5e9eaa53107a tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6013ed73af5b463b9a485a9a57e172b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3aa9fd0a124dfe822a66f424969beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:19.695946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-83730adf-7ec2-4dc5-896c-ebc2254bb682 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1739 microversion: 2.20 time: 0.326060 Aug 09 18:25:19.696694 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 448/871] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:19 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1739 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:19.701534 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-eda92ca4-2769-4c26-b939-5e9eaa53107a tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] 10.222.0.36 "GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb" status: 200 len: 1314 microversion: 2.1 time: 0.279493 Aug 09 18:25:19.702791 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 424/872] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:19 2022] GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:25:20.723441 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-23b2f328-0c7c-4809-998c-632fb2632d49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:20.724192 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-592b4664-614b-47c9-ab33-128101b1f8be tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:20.724814 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-592b4664-614b-47c9-ab33-128101b1f8be tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] [instance: 317e309c-4c25-4ff8-90d9-10ade4cf06fb] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:20.724958 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-23b2f328-0c7c-4809-998c-632fb2632d49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:20.738490 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-23b2f328-0c7c-4809-998c-632fb2632d49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:20.738490 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-23b2f328-0c7c-4809-998c-632fb2632d49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:20.738490 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-23b2f328-0c7c-4809-998c-632fb2632d49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:20.738490 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-23b2f328-0c7c-4809-998c-632fb2632d49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:20.738861 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-23b2f328-0c7c-4809-998c-632fb2632d49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:20.738937 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-592b4664-614b-47c9-ab33-128101b1f8be tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:20.739030 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-23b2f328-0c7c-4809-998c-632fb2632d49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:20.739115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-592b4664-614b-47c9-ab33-128101b1f8be tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:20.739115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-592b4664-614b-47c9-ab33-128101b1f8be tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:20.739115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-592b4664-614b-47c9-ab33-128101b1f8be tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:20.776123 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-592b4664-614b-47c9-ab33-128101b1f8be tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:20.776123 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-592b4664-614b-47c9-ab33-128101b1f8be tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:20.776123 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=100 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:25:20.908691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-23b2f328-0c7c-4809-998c-632fb2632d49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:20.918576 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-23b2f328-0c7c-4809-998c-632fb2632d49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:20.921722 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-23b2f328-0c7c-4809-998c-632fb2632d49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:20.924029 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-23b2f328-0c7c-4809-998c-632fb2632d49 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1739 microversion: 2.20 time: 0.205947 Aug 09 18:25:20.924718 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 449/873] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:20 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:21.087654 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=2 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:25:21.098508 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-592b4664-614b-47c9-ab33-128101b1f8be tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6013ed73af5b463b9a485a9a57e172b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3aa9fd0a124dfe822a66f424969beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:21.105734 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-592b4664-614b-47c9-ab33-128101b1f8be tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] 10.222.0.36 "GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb" status: 200 len: 1314 microversion: 2.1 time: 0.385686 Aug 09 18:25:21.106301 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 425/874] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:20 2022] GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:25:21.952255 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-10e92790-61f3-4b08-8a6f-ee354b659ea2 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:21.953629 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-10e92790-61f3-4b08-8a6f-ee354b659ea2 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:21.960608 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-10e92790-61f3-4b08-8a6f-ee354b659ea2 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:21.961350 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-10e92790-61f3-4b08-8a6f-ee354b659ea2 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:21.962006 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-10e92790-61f3-4b08-8a6f-ee354b659ea2 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:21.962720 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-10e92790-61f3-4b08-8a6f-ee354b659ea2 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:21.963375 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-10e92790-61f3-4b08-8a6f-ee354b659ea2 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:21.969002 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-10e92790-61f3-4b08-8a6f-ee354b659ea2 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:22.114142 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-10e92790-61f3-4b08-8a6f-ee354b659ea2 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:22.122221 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-10e92790-61f3-4b08-8a6f-ee354b659ea2 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:22.126426 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-10e92790-61f3-4b08-8a6f-ee354b659ea2 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:22.126426 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-10e92790-61f3-4b08-8a6f-ee354b659ea2 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1739 microversion: 2.20 time: 0.177657 Aug 09 18:25:22.126426 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 450/875] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:21 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:22.128513 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-7678877b-0115-4fa4-8e13-83a485818b8c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:22.128917 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-7678877b-0115-4fa4-8e13-83a485818b8c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] [instance: 317e309c-4c25-4ff8-90d9-10ade4cf06fb] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:22.130930 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=6 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:25:22.136647 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7678877b-0115-4fa4-8e13-83a485818b8c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:22.137132 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7678877b-0115-4fa4-8e13-83a485818b8c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:22.137569 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7678877b-0115-4fa4-8e13-83a485818b8c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:22.138262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7678877b-0115-4fa4-8e13-83a485818b8c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:22.139018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7678877b-0115-4fa4-8e13-83a485818b8c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:22.139742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7678877b-0115-4fa4-8e13-83a485818b8c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:22.281655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-7678877b-0115-4fa4-8e13-83a485818b8c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6013ed73af5b463b9a485a9a57e172b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3aa9fd0a124dfe822a66f424969beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:22.289046 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-7678877b-0115-4fa4-8e13-83a485818b8c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] 10.222.0.36 "GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb" status: 200 len: 1314 microversion: 2.1 time: 0.166094 Aug 09 18:25:22.289624 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 426/876] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:22 2022] GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:22.820404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-a491b050-b97c-40ff-a767-3e99a9d5364b req-adc03429-10f5-413b-90d5-d204eb6d7095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317e309c-4c25-4ff8-90d9-10ade4cf06fb", "name": "network-vif-plugged", "status": "completed", "tag": "f654232c-51d7-4940-822d-8f227ee7d403"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:25:22.825345 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=4 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:25:22.831061 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-a491b050-b97c-40ff-a767-3e99a9d5364b req-adc03429-10f5-413b-90d5-d204eb6d7095 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:22.831543 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-a491b050-b97c-40ff-a767-3e99a9d5364b req-adc03429-10f5-413b-90d5-d204eb6d7095 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:22.831977 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-a491b050-b97c-40ff-a767-3e99a9d5364b req-adc03429-10f5-413b-90d5-d204eb6d7095 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:22.843549 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-a491b050-b97c-40ff-a767-3e99a9d5364b req-adc03429-10f5-413b-90d5-d204eb6d7095 service nova] Creating event network-vif-plugged:f654232c-51d7-4940-822d-8f227ee7d403 for instance 317e309c-4c25-4ff8-90d9-10ade4cf06fb on hv-cinder-79797 Aug 09 18:25:22.848686 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-a491b050-b97c-40ff-a767-3e99a9d5364b req-adc03429-10f5-413b-90d5-d204eb6d7095 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032059 Aug 09 18:25:22.849308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 451/877] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:25:23.151125 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c1156689-0110-4b77-926e-6be8ef446a1c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:23.151742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c1156689-0110-4b77-926e-6be8ef446a1c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:23.159371 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c1156689-0110-4b77-926e-6be8ef446a1c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:23.162946 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c1156689-0110-4b77-926e-6be8ef446a1c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:23.162946 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c1156689-0110-4b77-926e-6be8ef446a1c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:23.162946 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c1156689-0110-4b77-926e-6be8ef446a1c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:23.162946 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c1156689-0110-4b77-926e-6be8ef446a1c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:23.163372 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c1156689-0110-4b77-926e-6be8ef446a1c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:23.294743 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c1156689-0110-4b77-926e-6be8ef446a1c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:23.302598 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c1156689-0110-4b77-926e-6be8ef446a1c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:23.304116 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c1156689-0110-4b77-926e-6be8ef446a1c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:23.305354 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c1156689-0110-4b77-926e-6be8ef446a1c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1739 microversion: 2.20 time: 0.158152 Aug 09 18:25:23.305907 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 427/878] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:23 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:23.311227 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-06145d85-8920-493d-a93c-83fa99fa670c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:23.311931 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-06145d85-8920-493d-a93c-83fa99fa670c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] [instance: 317e309c-4c25-4ff8-90d9-10ade4cf06fb] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:23.318939 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-06145d85-8920-493d-a93c-83fa99fa670c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:23.319424 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-06145d85-8920-493d-a93c-83fa99fa670c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:23.319863 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-06145d85-8920-493d-a93c-83fa99fa670c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:23.320551 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-06145d85-8920-493d-a93c-83fa99fa670c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:23.321013 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-06145d85-8920-493d-a93c-83fa99fa670c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:23.321437 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-06145d85-8920-493d-a93c-83fa99fa670c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:23.509859 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-06145d85-8920-493d-a93c-83fa99fa670c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6013ed73af5b463b9a485a9a57e172b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3aa9fd0a124dfe822a66f424969beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:23.518038 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-06145d85-8920-493d-a93c-83fa99fa670c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] 10.222.0.36 "GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb" status: 200 len: 1314 microversion: 2.1 time: 0.211242 Aug 09 18:25:23.518755 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 452/879] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:23 2022] GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:25:24.328445 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-1a111e69-5343-4061-824a-43b1812efcaa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:24.329048 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-1a111e69-5343-4061-824a-43b1812efcaa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:24.335417 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1a111e69-5343-4061-824a-43b1812efcaa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:24.335896 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1a111e69-5343-4061-824a-43b1812efcaa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:24.336328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1a111e69-5343-4061-824a-43b1812efcaa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:24.337030 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1a111e69-5343-4061-824a-43b1812efcaa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:24.337480 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1a111e69-5343-4061-824a-43b1812efcaa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:24.337897 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1a111e69-5343-4061-824a-43b1812efcaa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:24.473318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-1a111e69-5343-4061-824a-43b1812efcaa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:24.481107 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-1a111e69-5343-4061-824a-43b1812efcaa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:24.483585 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-1a111e69-5343-4061-824a-43b1812efcaa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:24.485094 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-1a111e69-5343-4061-824a-43b1812efcaa tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1721 microversion: 2.20 time: 0.161080 Aug 09 18:25:24.485609 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 428/880] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:24 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:24.540509 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-3f8f0b1b-139c-4c3c-92ef-3acf6a4d200c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:24.541113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-3f8f0b1b-139c-4c3c-92ef-3acf6a4d200c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] [instance: 317e309c-4c25-4ff8-90d9-10ade4cf06fb] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:24.548155 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3f8f0b1b-139c-4c3c-92ef-3acf6a4d200c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:24.548638 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3f8f0b1b-139c-4c3c-92ef-3acf6a4d200c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:24.549103 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3f8f0b1b-139c-4c3c-92ef-3acf6a4d200c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:24.549842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3f8f0b1b-139c-4c3c-92ef-3acf6a4d200c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:24.550301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3f8f0b1b-139c-4c3c-92ef-3acf6a4d200c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:24.550744 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3f8f0b1b-139c-4c3c-92ef-3acf6a4d200c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:24.686491 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-3f8f0b1b-139c-4c3c-92ef-3acf6a4d200c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6013ed73af5b463b9a485a9a57e172b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3aa9fd0a124dfe822a66f424969beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:24.694025 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-3f8f0b1b-139c-4c3c-92ef-3acf6a4d200c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] 10.222.0.36 "GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb" status: 200 len: 1314 microversion: 2.1 time: 0.157903 Aug 09 18:25:24.694602 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 453/881] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:24 2022] GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:25:25.508256 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-b8d78e62-b83d-45c9-b2ed-7df3ddbbf83e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:25.508886 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-b8d78e62-b83d-45c9-b2ed-7df3ddbbf83e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:25.515237 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8d78e62-b83d-45c9-b2ed-7df3ddbbf83e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:25.515720 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8d78e62-b83d-45c9-b2ed-7df3ddbbf83e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:25.516155 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8d78e62-b83d-45c9-b2ed-7df3ddbbf83e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:25.516837 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8d78e62-b83d-45c9-b2ed-7df3ddbbf83e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:25.517289 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8d78e62-b83d-45c9-b2ed-7df3ddbbf83e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:25.517715 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8d78e62-b83d-45c9-b2ed-7df3ddbbf83e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:25.653583 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-b8d78e62-b83d-45c9-b2ed-7df3ddbbf83e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:25.662086 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-b8d78e62-b83d-45c9-b2ed-7df3ddbbf83e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:25.663616 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-b8d78e62-b83d-45c9-b2ed-7df3ddbbf83e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:25.664832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-b8d78e62-b83d-45c9-b2ed-7df3ddbbf83e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1721 microversion: 2.20 time: 0.160448 Aug 09 18:25:25.665384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 429/882] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:25 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:25.716118 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-8d9be727-6547-489c-968e-e134f2e0c7df tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:25.716599 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-8d9be727-6547-489c-968e-e134f2e0c7df tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] [instance: 317e309c-4c25-4ff8-90d9-10ade4cf06fb] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:25.719138 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=46 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:25:25.724118 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8d9be727-6547-489c-968e-e134f2e0c7df tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:25.724625 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8d9be727-6547-489c-968e-e134f2e0c7df tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:25.725055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8d9be727-6547-489c-968e-e134f2e0c7df tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:25.725750 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8d9be727-6547-489c-968e-e134f2e0c7df tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:25.726211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8d9be727-6547-489c-968e-e134f2e0c7df tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:25.726644 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8d9be727-6547-489c-968e-e134f2e0c7df tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:25.861021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-8d9be727-6547-489c-968e-e134f2e0c7df tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6013ed73af5b463b9a485a9a57e172b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3aa9fd0a124dfe822a66f424969beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:25.868490 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-8d9be727-6547-489c-968e-e134f2e0c7df tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] 10.222.0.36 "GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb" status: 200 len: 1464 microversion: 2.1 time: 0.156757 Aug 09 18:25:25.869067 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 454/883] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:25 2022] GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb => generated 1464 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:25:25.914263 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-044ada80-ea09-4624-b383-2034a0a66f80 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:25.914790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-044ada80-ea09-4624-b383-2034a0a66f80 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] [instance: 317e309c-4c25-4ff8-90d9-10ade4cf06fb] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:25.921378 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-044ada80-ea09-4624-b383-2034a0a66f80 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:25.921855 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-044ada80-ea09-4624-b383-2034a0a66f80 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:25.922293 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-044ada80-ea09-4624-b383-2034a0a66f80 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:25.923009 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-044ada80-ea09-4624-b383-2034a0a66f80 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:25.923465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-044ada80-ea09-4624-b383-2034a0a66f80 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:25.923890 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-044ada80-ea09-4624-b383-2034a0a66f80 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:25.947875 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-044ada80-ea09-4624-b383-2034a0a66f80 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] [instance: 317e309c-4c25-4ff8-90d9-10ade4cf06fb] Going to try to terminate instance {{(pid=118314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:25:26.234756 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-044ada80-ea09-4624-b383-2034a0a66f80 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] 10.222.0.36 "DELETE /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb" status: 204 len: 0 microversion: 2.1 time: 0.324046 Aug 09 18:25:26.235380 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 430/884] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:25:25 2022] DELETE /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:25:26.243889 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b8a0a4e5-a6f8-48fb-a8a1-8e062721f174 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:26.244494 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-b8a0a4e5-a6f8-48fb-a8a1-8e062721f174 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] [instance: 317e309c-4c25-4ff8-90d9-10ade4cf06fb] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:26.250537 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b8a0a4e5-a6f8-48fb-a8a1-8e062721f174 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:26.251018 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b8a0a4e5-a6f8-48fb-a8a1-8e062721f174 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:26.251458 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b8a0a4e5-a6f8-48fb-a8a1-8e062721f174 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:26.252143 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b8a0a4e5-a6f8-48fb-a8a1-8e062721f174 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:26.252602 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b8a0a4e5-a6f8-48fb-a8a1-8e062721f174 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:26.253023 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b8a0a4e5-a6f8-48fb-a8a1-8e062721f174 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:26.381311 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b8a0a4e5-a6f8-48fb-a8a1-8e062721f174 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6013ed73af5b463b9a485a9a57e172b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3aa9fd0a124dfe822a66f424969beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:26.389212 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b8a0a4e5-a6f8-48fb-a8a1-8e062721f174 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] 10.222.0.36 "GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb" status: 200 len: 1470 microversion: 2.1 time: 0.148637 Aug 09 18:25:26.389808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 455/885] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:26 2022] GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:25:26.684299 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-a03675d1-bc96-4302-941f-07ec2602cb75 req-6d92dc58-3b65-4b0a-bcc4-ce024cf399b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262e54dc-8819-4689-ad3a-577f966f5a21", "name": "network-vif-unplugged", "status": "completed", "tag": "0326ddaa-6e24-40bf-9ac7-991d3e2669c4"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:25:26.688718 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-20e61a44-a9bd-41f3-95cd-a1696b2a03e6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:26.689330 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-20e61a44-a9bd-41f3-95cd-a1696b2a03e6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:26.690837 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:25:26.695724 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-20e61a44-a9bd-41f3-95cd-a1696b2a03e6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:26.696137 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-a03675d1-bc96-4302-941f-07ec2602cb75 req-6d92dc58-3b65-4b0a-bcc4-ce024cf399b9 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:26.696262 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-20e61a44-a9bd-41f3-95cd-a1696b2a03e6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:26.696643 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-20e61a44-a9bd-41f3-95cd-a1696b2a03e6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:26.696819 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-a03675d1-bc96-4302-941f-07ec2602cb75 req-6d92dc58-3b65-4b0a-bcc4-ce024cf399b9 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:26.697302 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-a03675d1-bc96-4302-941f-07ec2602cb75 req-6d92dc58-3b65-4b0a-bcc4-ce024cf399b9 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:26.697417 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-20e61a44-a9bd-41f3-95cd-a1696b2a03e6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:26.697816 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-20e61a44-a9bd-41f3-95cd-a1696b2a03e6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:26.698246 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-20e61a44-a9bd-41f3-95cd-a1696b2a03e6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:26.711182 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-a03675d1-bc96-4302-941f-07ec2602cb75 req-6d92dc58-3b65-4b0a-bcc4-ce024cf399b9 service nova] Creating event network-vif-unplugged:0326ddaa-6e24-40bf-9ac7-991d3e2669c4 for instance 262e54dc-8819-4689-ad3a-577f966f5a21 on hv-cinder-79797 Aug 09 18:25:26.716041 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-a03675d1-bc96-4302-941f-07ec2602cb75 req-6d92dc58-3b65-4b0a-bcc4-ce024cf399b9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036128 Aug 09 18:25:26.716735 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 431/886] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:25:26.840284 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-20e61a44-a9bd-41f3-95cd-a1696b2a03e6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:26.848474 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-20e61a44-a9bd-41f3-95cd-a1696b2a03e6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:26.849976 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-20e61a44-a9bd-41f3-95cd-a1696b2a03e6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:26.851155 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-20e61a44-a9bd-41f3-95cd-a1696b2a03e6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1721 microversion: 2.20 time: 0.166846 Aug 09 18:25:26.851717 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 456/887] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:26 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:25:27.412804 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-206442d2-6233-403b-98d9-5e56c293c274 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:27.413518 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-206442d2-6233-403b-98d9-5e56c293c274 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] [instance: 317e309c-4c25-4ff8-90d9-10ade4cf06fb] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:27.420040 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-206442d2-6233-403b-98d9-5e56c293c274 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:27.420512 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-206442d2-6233-403b-98d9-5e56c293c274 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:27.420940 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-206442d2-6233-403b-98d9-5e56c293c274 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:27.422300 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-206442d2-6233-403b-98d9-5e56c293c274 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:27.422765 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-206442d2-6233-403b-98d9-5e56c293c274 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:27.428587 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-206442d2-6233-403b-98d9-5e56c293c274 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:27.554224 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-206442d2-6233-403b-98d9-5e56c293c274 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6013ed73af5b463b9a485a9a57e172b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3aa9fd0a124dfe822a66f424969beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:27.561698 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-206442d2-6233-403b-98d9-5e56c293c274 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] 10.222.0.36 "GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb" status: 200 len: 1470 microversion: 2.1 time: 0.153515 Aug 09 18:25:27.562365 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 432/888] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:27 2022] GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:25:27.874375 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-88b4cbd7-c70e-4ea2-8bc7-e78669aed72d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:27.875405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-88b4cbd7-c70e-4ea2-8bc7-e78669aed72d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:27.881941 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-88b4cbd7-c70e-4ea2-8bc7-e78669aed72d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:27.882421 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-88b4cbd7-c70e-4ea2-8bc7-e78669aed72d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:27.882886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-88b4cbd7-c70e-4ea2-8bc7-e78669aed72d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:27.883575 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-88b4cbd7-c70e-4ea2-8bc7-e78669aed72d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:27.884029 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-88b4cbd7-c70e-4ea2-8bc7-e78669aed72d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:27.884446 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-88b4cbd7-c70e-4ea2-8bc7-e78669aed72d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:28.019591 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-88b4cbd7-c70e-4ea2-8bc7-e78669aed72d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:28.027398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-88b4cbd7-c70e-4ea2-8bc7-e78669aed72d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:28.028908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-88b4cbd7-c70e-4ea2-8bc7-e78669aed72d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:28.030063 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-88b4cbd7-c70e-4ea2-8bc7-e78669aed72d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1721 microversion: 2.20 time: 0.159764 Aug 09 18:25:28.031411 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 457/889] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:27 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:28.582733 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-0b5e2405-ec5e-4bcc-a447-4ee51792e043 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:28.583340 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-0b5e2405-ec5e-4bcc-a447-4ee51792e043 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] [instance: 317e309c-4c25-4ff8-90d9-10ade4cf06fb] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:28.589997 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0b5e2405-ec5e-4bcc-a447-4ee51792e043 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:28.590473 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0b5e2405-ec5e-4bcc-a447-4ee51792e043 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:28.591726 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0b5e2405-ec5e-4bcc-a447-4ee51792e043 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:28.592455 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0b5e2405-ec5e-4bcc-a447-4ee51792e043 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:28.593061 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0b5e2405-ec5e-4bcc-a447-4ee51792e043 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:28.593611 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0b5e2405-ec5e-4bcc-a447-4ee51792e043 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:28.732934 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-0b5e2405-ec5e-4bcc-a447-4ee51792e043 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6013ed73af5b463b9a485a9a57e172b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3aa9fd0a124dfe822a66f424969beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:28.741512 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-0b5e2405-ec5e-4bcc-a447-4ee51792e043 tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] 10.222.0.36 "GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb" status: 200 len: 1470 microversion: 2.1 time: 0.162580 Aug 09 18:25:28.742093 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 433/890] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:28 2022] GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:25:29.054400 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-1e9084f7-54a8-4284-bea8-2b64d622d0fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:29.055339 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-1e9084f7-54a8-4284-bea8-2b64d622d0fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:29.064399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1e9084f7-54a8-4284-bea8-2b64d622d0fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:29.069735 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1e9084f7-54a8-4284-bea8-2b64d622d0fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:29.069735 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1e9084f7-54a8-4284-bea8-2b64d622d0fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:29.069735 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1e9084f7-54a8-4284-bea8-2b64d622d0fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:29.069735 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1e9084f7-54a8-4284-bea8-2b64d622d0fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:29.070746 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1e9084f7-54a8-4284-bea8-2b64d622d0fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:29.083473 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-f847e810-5458-4839-a6f1-393da1a05a5b req-d267f7c3-b12d-4fe8-9f4c-d98019ee39a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317e309c-4c25-4ff8-90d9-10ade4cf06fb", "name": "network-vif-deleted", "tag": "f654232c-51d7-4940-822d-8f227ee7d403"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:25:29.096139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-f847e810-5458-4839-a6f1-393da1a05a5b req-d267f7c3-b12d-4fe8-9f4c-d98019ee39a9 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:29.098013 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-f847e810-5458-4839-a6f1-393da1a05a5b req-d267f7c3-b12d-4fe8-9f4c-d98019ee39a9 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:29.098013 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-f847e810-5458-4839-a6f1-393da1a05a5b req-d267f7c3-b12d-4fe8-9f4c-d98019ee39a9 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:29.120039 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-f847e810-5458-4839-a6f1-393da1a05a5b req-d267f7c3-b12d-4fe8-9f4c-d98019ee39a9 service nova] Creating event network-vif-deleted:f654232c-51d7-4940-822d-8f227ee7d403 for instance 317e309c-4c25-4ff8-90d9-10ade4cf06fb on hv-cinder-79797 Aug 09 18:25:29.125246 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-f847e810-5458-4839-a6f1-393da1a05a5b req-d267f7c3-b12d-4fe8-9f4c-d98019ee39a9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054263 Aug 09 18:25:29.128452 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 434/891] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:25:29.214240 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-1e9084f7-54a8-4284-bea8-2b64d622d0fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:29.224190 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-1e9084f7-54a8-4284-bea8-2b64d622d0fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:29.225902 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-1e9084f7-54a8-4284-bea8-2b64d622d0fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:29.227095 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-1e9084f7-54a8-4284-bea8-2b64d622d0fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1664 microversion: 2.20 time: 0.176702 Aug 09 18:25:29.227650 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 458/892] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:29 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1664 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:25:29.251271 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-4ddaf89b-3d2e-4d28-b019-4dee2ccbaac6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3c9009a-5ca5-4ddf-876a-92822ba39d66"}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:25:29.253649 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-4ddaf89b-3d2e-4d28-b019-4dee2ccbaac6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:29.259925 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4ddaf89b-3d2e-4d28-b019-4dee2ccbaac6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:29.260405 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4ddaf89b-3d2e-4d28-b019-4dee2ccbaac6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:29.260839 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4ddaf89b-3d2e-4d28-b019-4dee2ccbaac6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:29.261522 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4ddaf89b-3d2e-4d28-b019-4dee2ccbaac6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:29.261970 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4ddaf89b-3d2e-4d28-b019-4dee2ccbaac6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:29.262395 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4ddaf89b-3d2e-4d28-b019-4dee2ccbaac6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:29.763428 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-1d3e5bc0-bfaf-4f0e-b6ce-fe888638224c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:29.764039 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-1d3e5bc0-bfaf-4f0e-b6ce-fe888638224c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] [instance: 317e309c-4c25-4ff8-90d9-10ade4cf06fb] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:29.770661 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1d3e5bc0-bfaf-4f0e-b6ce-fe888638224c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:29.771178 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1d3e5bc0-bfaf-4f0e-b6ce-fe888638224c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:29.771617 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1d3e5bc0-bfaf-4f0e-b6ce-fe888638224c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:29.772308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1d3e5bc0-bfaf-4f0e-b6ce-fe888638224c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:29.772765 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1d3e5bc0-bfaf-4f0e-b6ce-fe888638224c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:29.773197 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1d3e5bc0-bfaf-4f0e-b6ce-fe888638224c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:29.805214 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1d3e5bc0-bfaf-4f0e-b6ce-fe888638224c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:29.805698 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1d3e5bc0-bfaf-4f0e-b6ce-fe888638224c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:29.806135 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1d3e5bc0-bfaf-4f0e-b6ce-fe888638224c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:29.806580 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.objects.instance [None req-1d3e5bc0-bfaf-4f0e-b6ce-fe888638224c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lazy-loading 'fault' on Instance uuid 317e309c-4c25-4ff8-90d9-10ade4cf06fb {{(pid=118313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:25:29.809238 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=100 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:25:29.847964 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-1d3e5bc0-bfaf-4f0e-b6ce-fe888638224c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6013ed73af5b463b9a485a9a57e172b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3aa9fd0a124dfe822a66f424969beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:29.855434 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-1d3e5bc0-bfaf-4f0e-b6ce-fe888638224c tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] 10.222.0.36 "GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb" status: 200 len: 1304 microversion: 2.1 time: 0.095884 Aug 09 18:25:29.856431 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 459/893] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:29 2022] GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:30.158074 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-4ddaf89b-3d2e-4d28-b019-4dee2ccbaac6 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "POST /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.910909 Aug 09 18:25:30.158629 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 435/894] 10.222.0.36 () {62 vars in 1364 bytes} [Tue Aug 9 18:25:29 2022] POST /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21/os-volume_attachments => generated 188 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 18:25:30.280070 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-47453b86-3bd4-4405-a338-7e03682285a4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:30.280555 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-47453b86-3bd4-4405-a338-7e03682285a4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:30.287544 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-47453b86-3bd4-4405-a338-7e03682285a4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:30.288020 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-47453b86-3bd4-4405-a338-7e03682285a4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:30.288454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-47453b86-3bd4-4405-a338-7e03682285a4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:30.289130 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-47453b86-3bd4-4405-a338-7e03682285a4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:30.289578 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-47453b86-3bd4-4405-a338-7e03682285a4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:30.290003 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-47453b86-3bd4-4405-a338-7e03682285a4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:30.871448 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-47453b86-3bd4-4405-a338-7e03682285a4 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "DELETE /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21/os-volume_attachments/d3c9009a-5ca5-4ddf-876a-92822ba39d66" status: 202 len: 0 microversion: 2.20 time: 0.595161 Aug 09 18:25:30.872042 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 460/895] 10.222.0.36 () {60 vars in 1457 bytes} [Tue Aug 9 18:25:30 2022] DELETE /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21/os-volume_attachments/d3c9009a-5ca5-4ddf-876a-92822ba39d66 => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:25:30.877718 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8e0b2126-dcc4-4fc6-9519-4093e6b3405b tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:30.878403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8e0b2126-dcc4-4fc6-9519-4093e6b3405b tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] [instance: 317e309c-4c25-4ff8-90d9-10ade4cf06fb] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:30.886215 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e0b2126-dcc4-4fc6-9519-4093e6b3405b tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:30.886726 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e0b2126-dcc4-4fc6-9519-4093e6b3405b tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:30.887161 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e0b2126-dcc4-4fc6-9519-4093e6b3405b tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:30.887858 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e0b2126-dcc4-4fc6-9519-4093e6b3405b tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:30.888456 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e0b2126-dcc4-4fc6-9519-4093e6b3405b tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:30.888857 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e0b2126-dcc4-4fc6-9519-4093e6b3405b tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:30.903395 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-8e0b2126-dcc4-4fc6-9519-4093e6b3405b tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] HTTP exception thrown: Instance 317e309c-4c25-4ff8-90d9-10ade4cf06fb could not be found. Aug 09 18:25:30.905054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8e0b2126-dcc4-4fc6-9519-4093e6b3405b tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Request method failure captured: Aug 09 18:25:30.905054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb HTTP/1.1 Aug 09 18:25:30.905054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:25:30.905054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:25:30.905054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:25:30.905054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 0 Aug 09 18:25:30.905054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:25:30.905054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:25:30.905054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:25:30.905054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:25:30.905054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qaEfX6ulGQOd4n5QBP03CklL3Iyzcr0yusCFZwLrs8MAWLt3Rf68epxiLEpw22OLbtGg3Jd5ebeux9PzSqcUdBVSmk1b_OhglLjMa5m0Bal8VuJ0d7a8SDCjIYk82Uw9FU871lJ0J7T3VyfIBub4HgMy1J5ZoqeSm_WwTH8ahaqtQg Aug 09 18:25:30.905054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:25:30.905054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:25:30.905054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:25:30.905054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:25:30.905054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:25:30.905054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:25:30.905054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: eb3aa9fd0a124dfe822a66f424969beb Aug 09 18:25:30.905054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-VolumesNegativeTest-1002190025 Aug 09 18:25:30.905054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:25:30.905054 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:25:30.906848 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/eb3aa9fd0a124dfe822a66f424969beb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/eb3aa9fd0a124dfe822a66f424969beb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_eb3aa9fd0a124dfe822a66f424969beb", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/eb3aa9fd0a124dfe822a66f424969beb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:25:30.906848 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-VolumesNegativeTest-1002190025 Aug 09 18:25:30.906848 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: eb3aa9fd0a124dfe822a66f424969beb Aug 09 18:25:30.906848 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-VolumesNegativeTest-1002190025 Aug 09 18:25:30.906848 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-VolumesNegativeTest-1002190025-project Aug 09 18:25:30.906848 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:25:30.906848 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:25:30.906848 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: 6013ed73af5b463b9a485a9a57e172b4 Aug 09 18:25:30.906848 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-VolumesNegativeTest-1002190025-project Aug 09 18:25:30.906848 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: > Aug 09 18:25:30.906848 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Instance 317e309c-4c25-4ff8-90d9-10ade4cf06fb could not be found. Aug 09 18:25:30.906848 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'id': '317e309c-4c25-4ff8-90d9-10ade4cf06fb'} Aug 09 18:25:30.908582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:25:30.908582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:25:30.908582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:25:30.908582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:25:30.908582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:25:30.908582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:25:30.908582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:25:30.908582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:25:30.908582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:25:30.908582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:25:30.908582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317e309c-4c25-4ff8-90d9-10ade4cf06fb could not be found. Aug 09 18:25:30.908582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:25:30.908582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:25:30.908582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:25:30.908582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:25:30.908582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:25:30.908582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:25:30.908582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:25:30.908582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:25:30.908582 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:25:30.911469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:25:30.911469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:25:30.911469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:25:30.911469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:25:30.911469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:25:30.911469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:25:30.911469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:25:30.911469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317e309c-4c25-4ff8-90d9-10ade4cf06fb could not be found. Aug 09 18:25:30.911469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:25:30.911469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:25:30.911469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:25:30.911469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:25:30.911469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:25:30.911469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:25:30.911469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:25:30.911469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:25:30.911469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317e309c-4c25-4ff8-90d9-10ade4cf06fb could not be found. Aug 09 18:25:30.911469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:25:30.913526 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8e0b2126-dcc4-4fc6-9519-4093e6b3405b tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] Returning 404 to user: Instance 317e309c-4c25-4ff8-90d9-10ade4cf06fb could not be found. {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:25:30.913526 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8e0b2126-dcc4-4fc6-9519-4093e6b3405b tempest-VolumesNegativeTest-1002190025 tempest-VolumesNegativeTest-1002190025-project] 10.222.0.36 "GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb" status: 404 len: 111 microversion: 2.1 time: 0.032858 Aug 09 18:25:30.913526 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 436/896] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:30 2022] GET /compute/v2.1/servers/317e309c-4c25-4ff8-90d9-10ade4cf06fb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:25:30.934020 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f0bb442f-79ce-428e-a975-49c0c7773175 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:25:30.934611 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f0bb442f-79ce-428e-a975-49c0c7773175 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:30.941355 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f0bb442f-79ce-428e-a975-49c0c7773175 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:30.941844 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f0bb442f-79ce-428e-a975-49c0c7773175 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:30.942281 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f0bb442f-79ce-428e-a975-49c0c7773175 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:30.943062 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f0bb442f-79ce-428e-a975-49c0c7773175 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:30.943520 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f0bb442f-79ce-428e-a975-49c0c7773175 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:30.943944 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f0bb442f-79ce-428e-a975-49c0c7773175 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:30.974410 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f0bb442f-79ce-428e-a975-49c0c7773175 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118313) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 18:25:31.323023 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f0bb442f-79ce-428e-a975-49c0c7773175 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "POST /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21/action" status: 202 len: 0 microversion: 2.20 time: 0.392845 Aug 09 18:25:31.324394 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 461/897] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Aug 9 18:25:30 2022] POST /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:25:31.332365 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-dc76ad8b-d90c-4897-8c03-0db7f5f291af tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:31.332973 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-dc76ad8b-d90c-4897-8c03-0db7f5f291af tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:31.338836 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc76ad8b-d90c-4897-8c03-0db7f5f291af tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:31.343249 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc76ad8b-d90c-4897-8c03-0db7f5f291af tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:31.343249 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc76ad8b-d90c-4897-8c03-0db7f5f291af tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:31.343249 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc76ad8b-d90c-4897-8c03-0db7f5f291af tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:31.343249 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc76ad8b-d90c-4897-8c03-0db7f5f291af tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:31.343675 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc76ad8b-d90c-4897-8c03-0db7f5f291af tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:31.484589 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-dc76ad8b-d90c-4897-8c03-0db7f5f291af tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:31.493069 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-dc76ad8b-d90c-4897-8c03-0db7f5f291af tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:31.494583 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-dc76ad8b-d90c-4897-8c03-0db7f5f291af tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:31.495764 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-dc76ad8b-d90c-4897-8c03-0db7f5f291af tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1672 microversion: 2.20 time: 0.168004 Aug 09 18:25:31.496374 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 437/898] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:31 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:32.520342 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-fc017ccd-7dbd-47d5-a747-b5dffda8536d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:32.520901 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-fc017ccd-7dbd-47d5-a747-b5dffda8536d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:32.527181 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fc017ccd-7dbd-47d5-a747-b5dffda8536d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:32.527671 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fc017ccd-7dbd-47d5-a747-b5dffda8536d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:32.528104 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fc017ccd-7dbd-47d5-a747-b5dffda8536d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:32.528795 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fc017ccd-7dbd-47d5-a747-b5dffda8536d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:32.529244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fc017ccd-7dbd-47d5-a747-b5dffda8536d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:32.529660 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fc017ccd-7dbd-47d5-a747-b5dffda8536d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:32.673058 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-fc017ccd-7dbd-47d5-a747-b5dffda8536d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:32.681358 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-fc017ccd-7dbd-47d5-a747-b5dffda8536d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:32.682887 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-fc017ccd-7dbd-47d5-a747-b5dffda8536d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:32.684042 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-fc017ccd-7dbd-47d5-a747-b5dffda8536d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1674 microversion: 2.20 time: 0.168815 Aug 09 18:25:32.684607 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 462/899] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:32 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:33.708738 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-dacfd17f-5945-4942-b722-dd9a4801a367 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:33.709470 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-dacfd17f-5945-4942-b722-dd9a4801a367 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:33.716375 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dacfd17f-5945-4942-b722-dd9a4801a367 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:33.716957 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dacfd17f-5945-4942-b722-dd9a4801a367 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:33.717423 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dacfd17f-5945-4942-b722-dd9a4801a367 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:33.718119 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dacfd17f-5945-4942-b722-dd9a4801a367 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:33.718750 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dacfd17f-5945-4942-b722-dd9a4801a367 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:33.719909 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dacfd17f-5945-4942-b722-dd9a4801a367 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:33.852264 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-dacfd17f-5945-4942-b722-dd9a4801a367 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:33.861016 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-dacfd17f-5945-4942-b722-dd9a4801a367 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:33.863075 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-dacfd17f-5945-4942-b722-dd9a4801a367 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:33.864024 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-dacfd17f-5945-4942-b722-dd9a4801a367 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1730 microversion: 2.20 time: 0.160783 Aug 09 18:25:33.864578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 438/900] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:33 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:34.889173 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9c54a7ac-d8aa-4984-8b9c-df333f25017f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:34.890411 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9c54a7ac-d8aa-4984-8b9c-df333f25017f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:34.900266 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9c54a7ac-d8aa-4984-8b9c-df333f25017f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:34.901120 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9c54a7ac-d8aa-4984-8b9c-df333f25017f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:34.901787 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9c54a7ac-d8aa-4984-8b9c-df333f25017f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:34.902941 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9c54a7ac-d8aa-4984-8b9c-df333f25017f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:34.903986 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9c54a7ac-d8aa-4984-8b9c-df333f25017f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:34.910526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9c54a7ac-d8aa-4984-8b9c-df333f25017f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:35.072729 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9c54a7ac-d8aa-4984-8b9c-df333f25017f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:35.083853 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9c54a7ac-d8aa-4984-8b9c-df333f25017f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:35.085651 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9c54a7ac-d8aa-4984-8b9c-df333f25017f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:35.087159 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9c54a7ac-d8aa-4984-8b9c-df333f25017f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1730 microversion: 2.20 time: 0.202018 Aug 09 18:25:35.088006 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 463/901] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:34 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1730 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:36.261035 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d1202930-62d9-4368-8740-9a87f57f81d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:36.261712 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d1202930-62d9-4368-8740-9a87f57f81d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:36.268049 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d1202930-62d9-4368-8740-9a87f57f81d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:36.268586 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d1202930-62d9-4368-8740-9a87f57f81d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:36.269084 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d1202930-62d9-4368-8740-9a87f57f81d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:36.269848 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d1202930-62d9-4368-8740-9a87f57f81d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:36.270366 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d1202930-62d9-4368-8740-9a87f57f81d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:36.270819 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d1202930-62d9-4368-8740-9a87f57f81d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:36.407007 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d1202930-62d9-4368-8740-9a87f57f81d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:36.410856 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:25:36.416489 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d1202930-62d9-4368-8740-9a87f57f81d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:36.418006 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d1202930-62d9-4368-8740-9a87f57f81d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:36.425481 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d1202930-62d9-4368-8740-9a87f57f81d9 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1730 microversion: 2.20 time: 0.312519 Aug 09 18:25:36.425481 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 439/902] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:36 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1730 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:25:37.442919 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b1c6c76d-2c77-4bb3-8a4f-0cd2f1ff0c44 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:37.443612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-b1c6c76d-2c77-4bb3-8a4f-0cd2f1ff0c44 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:37.450383 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b1c6c76d-2c77-4bb3-8a4f-0cd2f1ff0c44 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:37.450920 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b1c6c76d-2c77-4bb3-8a4f-0cd2f1ff0c44 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:37.451540 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b1c6c76d-2c77-4bb3-8a4f-0cd2f1ff0c44 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:37.452463 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b1c6c76d-2c77-4bb3-8a4f-0cd2f1ff0c44 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:37.453118 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b1c6c76d-2c77-4bb3-8a4f-0cd2f1ff0c44 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:37.453799 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b1c6c76d-2c77-4bb3-8a4f-0cd2f1ff0c44 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:37.621353 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b1c6c76d-2c77-4bb3-8a4f-0cd2f1ff0c44 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:37.632216 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b1c6c76d-2c77-4bb3-8a4f-0cd2f1ff0c44 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:37.633987 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b1c6c76d-2c77-4bb3-8a4f-0cd2f1ff0c44 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:37.635589 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b1c6c76d-2c77-4bb3-8a4f-0cd2f1ff0c44 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1730 microversion: 2.20 time: 0.197972 Aug 09 18:25:37.636743 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 464/903] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:37 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1730 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:38.662071 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-81dd18ee-ff4b-443b-bab7-a64a86e49f8d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:38.663337 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-81dd18ee-ff4b-443b-bab7-a64a86e49f8d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:38.671649 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-81dd18ee-ff4b-443b-bab7-a64a86e49f8d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:38.672134 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-81dd18ee-ff4b-443b-bab7-a64a86e49f8d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:38.672567 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-81dd18ee-ff4b-443b-bab7-a64a86e49f8d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:38.673271 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-81dd18ee-ff4b-443b-bab7-a64a86e49f8d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:38.673722 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-81dd18ee-ff4b-443b-bab7-a64a86e49f8d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:38.674143 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-81dd18ee-ff4b-443b-bab7-a64a86e49f8d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:38.819492 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-81dd18ee-ff4b-443b-bab7-a64a86e49f8d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:38.828137 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-81dd18ee-ff4b-443b-bab7-a64a86e49f8d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:38.831361 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-81dd18ee-ff4b-443b-bab7-a64a86e49f8d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:38.832522 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-81dd18ee-ff4b-443b-bab7-a64a86e49f8d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1730 microversion: 2.20 time: 0.174313 Aug 09 18:25:38.833078 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 440/904] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:38 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:39.856440 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-04a17859-e1ed-4c24-aa1d-57b744e1d141 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:39.857059 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-04a17859-e1ed-4c24-aa1d-57b744e1d141 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:39.864380 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-04a17859-e1ed-4c24-aa1d-57b744e1d141 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:39.864859 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-04a17859-e1ed-4c24-aa1d-57b744e1d141 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:39.865294 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-04a17859-e1ed-4c24-aa1d-57b744e1d141 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:39.866009 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-04a17859-e1ed-4c24-aa1d-57b744e1d141 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:39.866464 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-04a17859-e1ed-4c24-aa1d-57b744e1d141 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:39.866919 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-04a17859-e1ed-4c24-aa1d-57b744e1d141 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:40.008926 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-04a17859-e1ed-4c24-aa1d-57b744e1d141 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:40.018537 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-04a17859-e1ed-4c24-aa1d-57b744e1d141 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:40.020068 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-04a17859-e1ed-4c24-aa1d-57b744e1d141 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:40.021362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-04a17859-e1ed-4c24-aa1d-57b744e1d141 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1730 microversion: 2.20 time: 0.168862 Aug 09 18:25:40.022198 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 465/905] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:39 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:40.788801 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-1ea84cec-923c-4cfa-b974-ff4b4305f6aa tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:40.789956 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-1ea84cec-923c-4cfa-b974-ff4b4305f6aa tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:40.791020 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-13fa0659-bd56-4879-9a3a-52d3dea25fb8 req-de69b315-4d6a-437b-957b-aa1f0ab5ae7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4979ac5e-c9e0-4028-8bfe-e928f34a6bf0", "tag": "8911ba4a-f945-4b8b-9d28-626b00b2addb"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:25:40.796940 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1ea84cec-923c-4cfa-b974-ff4b4305f6aa tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:40.797742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1ea84cec-923c-4cfa-b974-ff4b4305f6aa tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:40.798315 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1ea84cec-923c-4cfa-b974-ff4b4305f6aa tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:40.799126 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1ea84cec-923c-4cfa-b974-ff4b4305f6aa tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:40.799643 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1ea84cec-923c-4cfa-b974-ff4b4305f6aa tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:40.800139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1ea84cec-923c-4cfa-b974-ff4b4305f6aa tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:40.817075 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-13fa0659-bd56-4879-9a3a-52d3dea25fb8 req-de69b315-4d6a-437b-957b-aa1f0ab5ae7e service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:40.817620 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-13fa0659-bd56-4879-9a3a-52d3dea25fb8 req-de69b315-4d6a-437b-957b-aa1f0ab5ae7e service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:40.818047 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-13fa0659-bd56-4879-9a3a-52d3dea25fb8 req-de69b315-4d6a-437b-957b-aa1f0ab5ae7e service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:40.831300 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-13fa0659-bd56-4879-9a3a-52d3dea25fb8 req-de69b315-4d6a-437b-957b-aa1f0ab5ae7e service nova] Creating event network-changed:8911ba4a-f945-4b8b-9d28-626b00b2addb for instance 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 on hv-cinder-79797 Aug 09 18:25:40.836830 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-13fa0659-bd56-4879-9a3a-52d3dea25fb8 req-de69b315-4d6a-437b-957b-aa1f0ab5ae7e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049573 Aug 09 18:25:40.837764 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 466/906] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:25:40.840966 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-1ea84cec-923c-4cfa-b974-ff4b4305f6aa tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Going to try to terminate instance {{(pid=118314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:25:41.051835 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-414d35e0-ae2b-4013-9464-df0e6eda5cfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:41.054021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-414d35e0-ae2b-4013-9464-df0e6eda5cfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:41.064341 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-414d35e0-ae2b-4013-9464-df0e6eda5cfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:41.064838 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-414d35e0-ae2b-4013-9464-df0e6eda5cfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:41.065530 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-414d35e0-ae2b-4013-9464-df0e6eda5cfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:41.066433 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-414d35e0-ae2b-4013-9464-df0e6eda5cfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:41.066935 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-414d35e0-ae2b-4013-9464-df0e6eda5cfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:41.067370 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-414d35e0-ae2b-4013-9464-df0e6eda5cfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:41.153520 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-1ea84cec-923c-4cfa-b974-ff4b4305f6aa tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 204 len: 0 microversion: 2.1 time: 0.368372 Aug 09 18:25:41.154315 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 441/907] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:25:40 2022] DELETE /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:25:41.163945 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-92c520df-736a-4466-adb7-ad0e55b71fba tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:41.164654 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-92c520df-736a-4466-adb7-ad0e55b71fba tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:41.171586 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-92c520df-736a-4466-adb7-ad0e55b71fba tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:41.171811 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-92c520df-736a-4466-adb7-ad0e55b71fba tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:41.172387 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-92c520df-736a-4466-adb7-ad0e55b71fba tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:41.173925 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-92c520df-736a-4466-adb7-ad0e55b71fba tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:41.174742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-92c520df-736a-4466-adb7-ad0e55b71fba tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:41.175010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-92c520df-736a-4466-adb7-ad0e55b71fba tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:41.318949 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-414d35e0-ae2b-4013-9464-df0e6eda5cfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:41.328634 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-414d35e0-ae2b-4013-9464-df0e6eda5cfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:41.331413 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-414d35e0-ae2b-4013-9464-df0e6eda5cfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:41.332845 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-414d35e0-ae2b-4013-9464-df0e6eda5cfd tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1730 microversion: 2.20 time: 0.290761 Aug 09 18:25:41.357174 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 467/908] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:41 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1730 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:25:41.366593 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-92c520df-736a-4466-adb7-ad0e55b71fba tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:41.374885 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-92c520df-736a-4466-adb7-ad0e55b71fba tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.215247 Aug 09 18:25:41.376504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 442/909] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:41 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:42.361100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-52d63275-ca56-46f2-bd2f-855fa3c403fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:42.361708 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-52d63275-ca56-46f2-bd2f-855fa3c403fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:42.368530 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-52d63275-ca56-46f2-bd2f-855fa3c403fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:42.369288 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-52d63275-ca56-46f2-bd2f-855fa3c403fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:42.369906 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-52d63275-ca56-46f2-bd2f-855fa3c403fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:42.370816 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-52d63275-ca56-46f2-bd2f-855fa3c403fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:42.371437 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-52d63275-ca56-46f2-bd2f-855fa3c403fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:42.372050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-52d63275-ca56-46f2-bd2f-855fa3c403fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:42.397849 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d8414537-3908-491c-b86a-f99a953ae026 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:42.398464 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d8414537-3908-491c-b86a-f99a953ae026 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:42.404868 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d8414537-3908-491c-b86a-f99a953ae026 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:42.405418 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d8414537-3908-491c-b86a-f99a953ae026 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:42.405941 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d8414537-3908-491c-b86a-f99a953ae026 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:42.407189 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d8414537-3908-491c-b86a-f99a953ae026 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:42.408296 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d8414537-3908-491c-b86a-f99a953ae026 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:42.409379 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d8414537-3908-491c-b86a-f99a953ae026 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:42.574382 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-52d63275-ca56-46f2-bd2f-855fa3c403fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:42.585434 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-52d63275-ca56-46f2-bd2f-855fa3c403fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:42.588097 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-52d63275-ca56-46f2-bd2f-855fa3c403fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:42.589879 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-52d63275-ca56-46f2-bd2f-855fa3c403fe tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1730 microversion: 2.20 time: 0.233575 Aug 09 18:25:42.608262 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 468/910] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:42 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1730 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:42.611964 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d8414537-3908-491c-b86a-f99a953ae026 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:42.620864 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d8414537-3908-491c-b86a-f99a953ae026 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.226951 Aug 09 18:25:42.621827 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 443/911] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:42 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:43.617049 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c675dbf2-649a-4eb6-a370-e533996a00de tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:43.620672 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-c675dbf2-649a-4eb6-a370-e533996a00de tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:43.624074 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c675dbf2-649a-4eb6-a370-e533996a00de tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:43.624558 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c675dbf2-649a-4eb6-a370-e533996a00de tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:43.625017 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c675dbf2-649a-4eb6-a370-e533996a00de tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:43.626314 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c675dbf2-649a-4eb6-a370-e533996a00de tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:43.626798 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c675dbf2-649a-4eb6-a370-e533996a00de tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:43.627225 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c675dbf2-649a-4eb6-a370-e533996a00de tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:43.643363 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-9ad3f14d-3e0c-4ceb-8d9d-b821a500bacc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:43.644158 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-9ad3f14d-3e0c-4ceb-8d9d-b821a500bacc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:43.651548 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9ad3f14d-3e0c-4ceb-8d9d-b821a500bacc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:43.652440 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9ad3f14d-3e0c-4ceb-8d9d-b821a500bacc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:43.657928 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9ad3f14d-3e0c-4ceb-8d9d-b821a500bacc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:43.658679 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9ad3f14d-3e0c-4ceb-8d9d-b821a500bacc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:43.659281 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9ad3f14d-3e0c-4ceb-8d9d-b821a500bacc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:43.659656 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9ad3f14d-3e0c-4ceb-8d9d-b821a500bacc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:43.842481 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-c675dbf2-649a-4eb6-a370-e533996a00de tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:43.852746 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-c675dbf2-649a-4eb6-a370-e533996a00de tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:43.855306 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-c675dbf2-649a-4eb6-a370-e533996a00de tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:43.856972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-c675dbf2-649a-4eb6-a370-e533996a00de tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1730 microversion: 2.20 time: 0.243987 Aug 09 18:25:43.857644 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 469/912] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:43 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1730 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:43.873539 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-9ad3f14d-3e0c-4ceb-8d9d-b821a500bacc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:43.882012 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-9ad3f14d-3e0c-4ceb-8d9d-b821a500bacc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.242585 Aug 09 18:25:43.882578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 444/913] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:43 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:44.880746 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-4d168d14-b3d4-4365-b69e-d755c9a66776 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:44.881323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-4d168d14-b3d4-4365-b69e-d755c9a66776 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:44.887659 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d168d14-b3d4-4365-b69e-d755c9a66776 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:44.888146 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d168d14-b3d4-4365-b69e-d755c9a66776 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:44.888583 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d168d14-b3d4-4365-b69e-d755c9a66776 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:44.889275 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d168d14-b3d4-4365-b69e-d755c9a66776 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:44.889729 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d168d14-b3d4-4365-b69e-d755c9a66776 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:44.890151 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4d168d14-b3d4-4365-b69e-d755c9a66776 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:44.903595 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-9f214772-c7d5-435f-852b-3e0bc9a8913e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:44.904204 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-9f214772-c7d5-435f-852b-3e0bc9a8913e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:44.910635 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f214772-c7d5-435f-852b-3e0bc9a8913e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:44.911137 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f214772-c7d5-435f-852b-3e0bc9a8913e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:44.911571 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f214772-c7d5-435f-852b-3e0bc9a8913e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:44.912260 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f214772-c7d5-435f-852b-3e0bc9a8913e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:44.912715 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f214772-c7d5-435f-852b-3e0bc9a8913e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:44.913137 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f214772-c7d5-435f-852b-3e0bc9a8913e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:45.075881 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4d168d14-b3d4-4365-b69e-d755c9a66776 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:45.084251 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4d168d14-b3d4-4365-b69e-d755c9a66776 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:45.085758 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4d168d14-b3d4-4365-b69e-d755c9a66776 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:45.086949 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-4d168d14-b3d4-4365-b69e-d755c9a66776 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1730 microversion: 2.20 time: 0.210385 Aug 09 18:25:45.087848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 470/914] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:44 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1730 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:45.100326 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-9f214772-c7d5-435f-852b-3e0bc9a8913e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:45.108174 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-9f214772-c7d5-435f-852b-3e0bc9a8913e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.208135 Aug 09 18:25:45.108739 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 445/915] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:44 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:46.109082 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e14efc5a-ff0d-4027-8f16-3849090066ff tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:46.110208 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e14efc5a-ff0d-4027-8f16-3849090066ff tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:46.116698 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e14efc5a-ff0d-4027-8f16-3849090066ff tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:46.117177 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e14efc5a-ff0d-4027-8f16-3849090066ff tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:46.117609 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e14efc5a-ff0d-4027-8f16-3849090066ff tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:46.118292 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e14efc5a-ff0d-4027-8f16-3849090066ff tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:46.118770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e14efc5a-ff0d-4027-8f16-3849090066ff tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:46.119193 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e14efc5a-ff0d-4027-8f16-3849090066ff tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:46.130749 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-fe302289-3ce7-4f18-b86b-ebe45d8e2682 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:46.131486 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-fe302289-3ce7-4f18-b86b-ebe45d8e2682 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:46.137759 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fe302289-3ce7-4f18-b86b-ebe45d8e2682 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:46.138233 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fe302289-3ce7-4f18-b86b-ebe45d8e2682 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:46.138662 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fe302289-3ce7-4f18-b86b-ebe45d8e2682 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:46.139364 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fe302289-3ce7-4f18-b86b-ebe45d8e2682 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:46.139810 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fe302289-3ce7-4f18-b86b-ebe45d8e2682 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:46.140254 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fe302289-3ce7-4f18-b86b-ebe45d8e2682 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:46.262475 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e14efc5a-ff0d-4027-8f16-3849090066ff tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:46.272436 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e14efc5a-ff0d-4027-8f16-3849090066ff tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:46.273957 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e14efc5a-ff0d-4027-8f16-3849090066ff tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:46.275176 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e14efc5a-ff0d-4027-8f16-3849090066ff tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1730 microversion: 2.20 time: 0.170380 Aug 09 18:25:46.275752 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 471/916] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:46 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:46.420670 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-fe302289-3ce7-4f18-b86b-ebe45d8e2682 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:46.428841 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-fe302289-3ce7-4f18-b86b-ebe45d8e2682 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.301862 Aug 09 18:25:46.429397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 446/917] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:46 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:47.297588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-918a0ecd-14c0-4b0d-9de8-c01a694e4302 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:47.298255 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-918a0ecd-14c0-4b0d-9de8-c01a694e4302 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:47.304570 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-918a0ecd-14c0-4b0d-9de8-c01a694e4302 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:47.305049 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-918a0ecd-14c0-4b0d-9de8-c01a694e4302 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:47.305480 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-918a0ecd-14c0-4b0d-9de8-c01a694e4302 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:47.306164 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-918a0ecd-14c0-4b0d-9de8-c01a694e4302 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:47.306612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-918a0ecd-14c0-4b0d-9de8-c01a694e4302 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:47.307058 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-918a0ecd-14c0-4b0d-9de8-c01a694e4302 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:47.435738 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-918a0ecd-14c0-4b0d-9de8-c01a694e4302 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:47.444144 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-918a0ecd-14c0-4b0d-9de8-c01a694e4302 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:47.445652 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-918a0ecd-14c0-4b0d-9de8-c01a694e4302 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:47.447038 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-918a0ecd-14c0-4b0d-9de8-c01a694e4302 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1730 microversion: 2.20 time: 0.153551 Aug 09 18:25:47.447720 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 472/918] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:47 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:47.450723 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f5c44a65-d2e7-4490-85c4-bb9715fe6e7a tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:47.451343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f5c44a65-d2e7-4490-85c4-bb9715fe6e7a tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:47.459868 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f5c44a65-d2e7-4490-85c4-bb9715fe6e7a tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:47.460312 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f5c44a65-d2e7-4490-85c4-bb9715fe6e7a tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:47.460772 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f5c44a65-d2e7-4490-85c4-bb9715fe6e7a tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:47.461447 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f5c44a65-d2e7-4490-85c4-bb9715fe6e7a tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:47.461895 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f5c44a65-d2e7-4490-85c4-bb9715fe6e7a tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:47.462315 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f5c44a65-d2e7-4490-85c4-bb9715fe6e7a tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:47.595154 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f5c44a65-d2e7-4490-85c4-bb9715fe6e7a tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:47.602627 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f5c44a65-d2e7-4490-85c4-bb9715fe6e7a tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.155623 Aug 09 18:25:47.603205 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 447/919] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:47 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:48.469615 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-64804fd8-5aa1-4b52-8a6f-7776646eb387 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:48.471614 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-64804fd8-5aa1-4b52-8a6f-7776646eb387 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:48.478038 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-64804fd8-5aa1-4b52-8a6f-7776646eb387 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:48.478524 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-64804fd8-5aa1-4b52-8a6f-7776646eb387 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:48.478996 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-64804fd8-5aa1-4b52-8a6f-7776646eb387 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:48.479685 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-64804fd8-5aa1-4b52-8a6f-7776646eb387 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:48.480141 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-64804fd8-5aa1-4b52-8a6f-7776646eb387 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:48.480565 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-64804fd8-5aa1-4b52-8a6f-7776646eb387 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:48.495777 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:25:48.613370 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-64804fd8-5aa1-4b52-8a6f-7776646eb387 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:48.621654 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-64804fd8-5aa1-4b52-8a6f-7776646eb387 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:48.623216 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-64804fd8-5aa1-4b52-8a6f-7776646eb387 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:48.624416 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-64804fd8-5aa1-4b52-8a6f-7776646eb387 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1730 microversion: 2.20 time: 0.158882 Aug 09 18:25:48.624740 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-aba3b311-911d-49c6-8efb-fde38012883e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:48.625707 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 473/920] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:48 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:48.625882 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-aba3b311-911d-49c6-8efb-fde38012883e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:48.632196 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aba3b311-911d-49c6-8efb-fde38012883e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:48.632679 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aba3b311-911d-49c6-8efb-fde38012883e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:48.633111 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aba3b311-911d-49c6-8efb-fde38012883e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:48.633798 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aba3b311-911d-49c6-8efb-fde38012883e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:48.634283 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aba3b311-911d-49c6-8efb-fde38012883e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:48.634788 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aba3b311-911d-49c6-8efb-fde38012883e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:48.762849 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-aba3b311-911d-49c6-8efb-fde38012883e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:48.770508 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-aba3b311-911d-49c6-8efb-fde38012883e tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.149620 Aug 09 18:25:48.771103 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 448/921] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:48 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:25:49.648272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-7a9aedf3-8a04-43b9-9010-144b3187f297 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:49.648877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-7a9aedf3-8a04-43b9-9010-144b3187f297 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:49.655220 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7a9aedf3-8a04-43b9-9010-144b3187f297 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:49.655706 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7a9aedf3-8a04-43b9-9010-144b3187f297 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:49.656148 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7a9aedf3-8a04-43b9-9010-144b3187f297 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:49.657809 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7a9aedf3-8a04-43b9-9010-144b3187f297 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:49.658268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7a9aedf3-8a04-43b9-9010-144b3187f297 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:49.658696 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7a9aedf3-8a04-43b9-9010-144b3187f297 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:49.787600 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-7a9aedf3-8a04-43b9-9010-144b3187f297 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:49.791438 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c5524eb2-8581-4941-a107-33f7087a46cc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:49.792043 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c5524eb2-8581-4941-a107-33f7087a46cc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:49.795622 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-7a9aedf3-8a04-43b9-9010-144b3187f297 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:49.797138 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-7a9aedf3-8a04-43b9-9010-144b3187f297 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:49.798306 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-7a9aedf3-8a04-43b9-9010-144b3187f297 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1730 microversion: 2.20 time: 0.154113 Aug 09 18:25:49.798424 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5524eb2-8581-4941-a107-33f7087a46cc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:49.798896 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 474/922] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:49 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:49.799022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5524eb2-8581-4941-a107-33f7087a46cc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:49.799376 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5524eb2-8581-4941-a107-33f7087a46cc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:49.800058 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5524eb2-8581-4941-a107-33f7087a46cc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:49.800508 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5524eb2-8581-4941-a107-33f7087a46cc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:49.800926 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c5524eb2-8581-4941-a107-33f7087a46cc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:49.929174 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c5524eb2-8581-4941-a107-33f7087a46cc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:49.936512 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c5524eb2-8581-4941-a107-33f7087a46cc tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1570 microversion: 2.1 time: 0.148816 Aug 09 18:25:49.937065 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 449/923] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:49 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:50.223109 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b6e2e7ae-daaf-4651-a271-325a106834f9 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-292785487"}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:25:50.223581 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-b6e2e7ae-daaf-4651-a271-325a106834f9 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:50.229860 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b6e2e7ae-daaf-4651-a271-325a106834f9 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:50.230362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b6e2e7ae-daaf-4651-a271-325a106834f9 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:50.230860 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b6e2e7ae-daaf-4651-a271-325a106834f9 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:50.231572 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b6e2e7ae-daaf-4651-a271-325a106834f9 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:50.232034 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b6e2e7ae-daaf-4651-a271-325a106834f9 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:50.233142 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b6e2e7ae-daaf-4651-a271-325a106834f9 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:50.398433 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.network.security_group_api [None req-b6e2e7ae-daaf-4651-a271-325a106834f9 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Removing security group ebe5873c-5f1e-4e62-822a-1d575b0a6b53 from port 6517c4a8-4f1c-427c-b492-618a0970aaef Aug 09 18:25:50.823780 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8704f163-dd6c-4ee6-ba06-6b0bfa008e63 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:50.825240 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8704f163-dd6c-4ee6-ba06-6b0bfa008e63 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:50.834429 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8704f163-dd6c-4ee6-ba06-6b0bfa008e63 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:50.835287 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8704f163-dd6c-4ee6-ba06-6b0bfa008e63 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:50.836637 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8704f163-dd6c-4ee6-ba06-6b0bfa008e63 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:50.837597 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8704f163-dd6c-4ee6-ba06-6b0bfa008e63 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:50.838218 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8704f163-dd6c-4ee6-ba06-6b0bfa008e63 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:50.838840 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8704f163-dd6c-4ee6-ba06-6b0bfa008e63 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:51.197326 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b6e2e7ae-daaf-4651-a271-325a106834f9 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "POST /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8/action" status: 202 len: 0 microversion: 2.1 time: 0.978479 Aug 09 18:25:51.197955 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 475/924] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Aug 9 18:25:50 2022] POST /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8/action => generated 0 bytes in 980 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:25:51.203634 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-66bcbd93-fadf-436e-8652-d4950070562c tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:51.204295 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-66bcbd93-fadf-436e-8652-d4950070562c tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:51.213008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-66bcbd93-fadf-436e-8652-d4950070562c tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:51.213008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-66bcbd93-fadf-436e-8652-d4950070562c tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:51.213008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-66bcbd93-fadf-436e-8652-d4950070562c tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:51.213008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-66bcbd93-fadf-436e-8652-d4950070562c tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:51.213558 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-66bcbd93-fadf-436e-8652-d4950070562c tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:51.213993 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-66bcbd93-fadf-436e-8652-d4950070562c tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:51.261212 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8704f163-dd6c-4ee6-ba06-6b0bfa008e63 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:51.270933 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8704f163-dd6c-4ee6-ba06-6b0bfa008e63 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:51.272506 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8704f163-dd6c-4ee6-ba06-6b0bfa008e63 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:51.273661 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8704f163-dd6c-4ee6-ba06-6b0bfa008e63 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1730 microversion: 2.20 time: 0.455919 Aug 09 18:25:51.274211 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 450/925] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:50 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1730 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:51.279546 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-d09d3ec7-e316-4a41-b167-8f49222d862c req-eea5b6e9-8e02-4e40-b942-28e4757ce7eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "641782b3-69ae-49c4-bc58-608cf91d08f8", "tag": "6517c4a8-4f1c-427c-b492-618a0970aaef"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:25:51.299465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-d09d3ec7-e316-4a41-b167-8f49222d862c req-eea5b6e9-8e02-4e40-b942-28e4757ce7eb service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:51.300270 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-d09d3ec7-e316-4a41-b167-8f49222d862c req-eea5b6e9-8e02-4e40-b942-28e4757ce7eb service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:51.301535 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-d09d3ec7-e316-4a41-b167-8f49222d862c req-eea5b6e9-8e02-4e40-b942-28e4757ce7eb service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:51.319540 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-d09d3ec7-e316-4a41-b167-8f49222d862c req-eea5b6e9-8e02-4e40-b942-28e4757ce7eb service nova] Creating event network-changed:6517c4a8-4f1c-427c-b492-618a0970aaef for instance 641782b3-69ae-49c4-bc58-608cf91d08f8 on hv-cinder-79797 Aug 09 18:25:51.326975 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-d09d3ec7-e316-4a41-b167-8f49222d862c req-eea5b6e9-8e02-4e40-b942-28e4757ce7eb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051211 Aug 09 18:25:51.328139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 451/926] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:25:51.614893 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-66bcbd93-fadf-436e-8652-d4950070562c tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:51.627522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-66bcbd93-fadf-436e-8652-d4950070562c tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1451 microversion: 2.1 time: 0.427982 Aug 09 18:25:51.629358 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 476/927] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:51 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1451 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:25:52.301156 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-9f34612f-e823-4ed1-b89e-817e04a36f27 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:52.301860 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-9f34612f-e823-4ed1-b89e-817e04a36f27 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:52.308591 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f34612f-e823-4ed1-b89e-817e04a36f27 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:52.309335 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f34612f-e823-4ed1-b89e-817e04a36f27 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:52.309972 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f34612f-e823-4ed1-b89e-817e04a36f27 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:52.310675 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f34612f-e823-4ed1-b89e-817e04a36f27 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:52.311358 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f34612f-e823-4ed1-b89e-817e04a36f27 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:52.311786 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9f34612f-e823-4ed1-b89e-817e04a36f27 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:52.540468 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5aa8a3c8-1ad6-4524-8aee-ce45dbf2a10c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:52.541618 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-5aa8a3c8-1ad6-4524-8aee-ce45dbf2a10c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:52.552877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5aa8a3c8-1ad6-4524-8aee-ce45dbf2a10c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:52.553530 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5aa8a3c8-1ad6-4524-8aee-ce45dbf2a10c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:52.553977 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5aa8a3c8-1ad6-4524-8aee-ce45dbf2a10c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:52.557317 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5aa8a3c8-1ad6-4524-8aee-ce45dbf2a10c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:52.557896 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5aa8a3c8-1ad6-4524-8aee-ce45dbf2a10c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:52.558344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5aa8a3c8-1ad6-4524-8aee-ce45dbf2a10c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:52.590773 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-9f34612f-e823-4ed1-b89e-817e04a36f27 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:52.603012 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-9f34612f-e823-4ed1-b89e-817e04a36f27 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:52.608766 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-9f34612f-e823-4ed1-b89e-817e04a36f27 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:52.624783 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-9f34612f-e823-4ed1-b89e-817e04a36f27 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1730 microversion: 2.20 time: 0.315599 Aug 09 18:25:52.630483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 452/928] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:52 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1730 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:52.635567 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-be72b477-25ab-46f0-8ca5-eef936c5d1c5 req-fbcda32e-b0bb-4226-9097-3fb03358b8aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "641782b3-69ae-49c4-bc58-608cf91d08f8", "tag": "6517c4a8-4f1c-427c-b492-618a0970aaef"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:25:52.650659 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-be72b477-25ab-46f0-8ca5-eef936c5d1c5 req-fbcda32e-b0bb-4226-9097-3fb03358b8aa service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:52.650659 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-be72b477-25ab-46f0-8ca5-eef936c5d1c5 req-fbcda32e-b0bb-4226-9097-3fb03358b8aa service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:52.650659 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-be72b477-25ab-46f0-8ca5-eef936c5d1c5 req-fbcda32e-b0bb-4226-9097-3fb03358b8aa service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:52.664666 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-be72b477-25ab-46f0-8ca5-eef936c5d1c5 req-fbcda32e-b0bb-4226-9097-3fb03358b8aa service nova] Creating event network-changed:6517c4a8-4f1c-427c-b492-618a0970aaef for instance 641782b3-69ae-49c4-bc58-608cf91d08f8 on hv-cinder-79797 Aug 09 18:25:52.666220 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.objects.instance [None req-5aa8a3c8-1ad6-4524-8aee-ce45dbf2a10c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lazy-loading 'services' on Instance uuid 641782b3-69ae-49c4-bc58-608cf91d08f8 {{(pid=118313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:25:52.670045 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-be72b477-25ab-46f0-8ca5-eef936c5d1c5 req-fbcda32e-b0bb-4226-9097-3fb03358b8aa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038061 Aug 09 18:25:52.670864 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 453/929] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:25:52.682896 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-5d444d6f-82b7-4a04-9bb1-e8167c6519f0 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:52.685586 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-5d444d6f-82b7-4a04-9bb1-e8167c6519f0 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:52.691904 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d444d6f-82b7-4a04-9bb1-e8167c6519f0 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:52.692480 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d444d6f-82b7-4a04-9bb1-e8167c6519f0 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:52.692850 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d444d6f-82b7-4a04-9bb1-e8167c6519f0 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:52.693612 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d444d6f-82b7-4a04-9bb1-e8167c6519f0 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:52.694076 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d444d6f-82b7-4a04-9bb1-e8167c6519f0 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:52.694504 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d444d6f-82b7-4a04-9bb1-e8167c6519f0 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:52.762335 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-5d444d6f-82b7-4a04-9bb1-e8167c6519f0 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:52.772875 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-5d444d6f-82b7-4a04-9bb1-e8167c6519f0 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1220 microversion: 2.1 time: 0.100201 Aug 09 18:25:52.785182 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 454/930] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:52 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:25:52.914613 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-5aa8a3c8-1ad6-4524-8aee-ce45dbf2a10c tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "DELETE /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8/os-volume_attachments/936a5271-864e-4152-a322-84f2cfb8d3ac" status: 202 len: 0 microversion: 2.1 time: 0.378166 Aug 09 18:25:52.915429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 477/931] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Aug 9 18:25:52 2022] DELETE /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8/os-volume_attachments/936a5271-864e-4152-a322-84f2cfb8d3ac => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:25:52.925852 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-bab6b97a-847e-4f42-a021-4f3fefcf30b8 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:52.929135 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-bab6b97a-847e-4f42-a021-4f3fefcf30b8 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:52.938232 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bab6b97a-847e-4f42-a021-4f3fefcf30b8 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:52.939838 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bab6b97a-847e-4f42-a021-4f3fefcf30b8 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:52.941856 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bab6b97a-847e-4f42-a021-4f3fefcf30b8 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:52.941856 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bab6b97a-847e-4f42-a021-4f3fefcf30b8 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:52.941856 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bab6b97a-847e-4f42-a021-4f3fefcf30b8 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:52.942185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bab6b97a-847e-4f42-a021-4f3fefcf30b8 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:52.977010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-bab6b97a-847e-4f42-a021-4f3fefcf30b8 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056774 Aug 09 18:25:52.978014 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 455/932] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Aug 9 18:25:52 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:25:53.133153 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-b278137d-f8bb-46c8-b62e-aab0d4328b29 req-b4565002-a2ea-43a3-8c2f-59f1b0633bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262e54dc-8819-4689-ad3a-577f966f5a21", "name": "network-vif-plugged", "status": "completed", "tag": "0326ddaa-6e24-40bf-9ac7-991d3e2669c4"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:25:53.143320 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-b278137d-f8bb-46c8-b62e-aab0d4328b29 req-b4565002-a2ea-43a3-8c2f-59f1b0633bf7 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:53.143882 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-b278137d-f8bb-46c8-b62e-aab0d4328b29 req-b4565002-a2ea-43a3-8c2f-59f1b0633bf7 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:53.144310 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-b278137d-f8bb-46c8-b62e-aab0d4328b29 req-b4565002-a2ea-43a3-8c2f-59f1b0633bf7 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:53.155549 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-b278137d-f8bb-46c8-b62e-aab0d4328b29 req-b4565002-a2ea-43a3-8c2f-59f1b0633bf7 service nova] Creating event network-vif-plugged:0326ddaa-6e24-40bf-9ac7-991d3e2669c4 for instance 262e54dc-8819-4689-ad3a-577f966f5a21 on hv-cinder-79797 Aug 09 18:25:53.161067 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-b278137d-f8bb-46c8-b62e-aab0d4328b29 req-b4565002-a2ea-43a3-8c2f-59f1b0633bf7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032121 Aug 09 18:25:53.161670 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 478/933] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:25:53.356368 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-bd5c6422-0ca2-4d4b-8007-9b535b3d351e req-72f81135-6019-41dd-9df1-87ba6e9df641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4979ac5e-c9e0-4028-8bfe-e928f34a6bf0", "name": "network-vif-deleted", "tag": "8911ba4a-f945-4b8b-9d28-626b00b2addb"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:25:53.367554 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-bd5c6422-0ca2-4d4b-8007-9b535b3d351e req-72f81135-6019-41dd-9df1-87ba6e9df641 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:53.368037 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-bd5c6422-0ca2-4d4b-8007-9b535b3d351e req-72f81135-6019-41dd-9df1-87ba6e9df641 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:53.371037 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-bd5c6422-0ca2-4d4b-8007-9b535b3d351e req-72f81135-6019-41dd-9df1-87ba6e9df641 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:53.372599 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:25:53.383085 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-bd5c6422-0ca2-4d4b-8007-9b535b3d351e req-72f81135-6019-41dd-9df1-87ba6e9df641 service nova] Creating event network-vif-deleted:8911ba4a-f945-4b8b-9d28-626b00b2addb for instance 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 on hv-cinder-79797 Aug 09 18:25:53.387933 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-bd5c6422-0ca2-4d4b-8007-9b535b3d351e req-72f81135-6019-41dd-9df1-87ba6e9df641 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035323 Aug 09 18:25:53.388532 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 456/934] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:25:53.638214 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-ad7b71d9-68f8-417c-bb98-ab015695b039 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:53.639063 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-ad7b71d9-68f8-417c-bb98-ab015695b039 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:53.647096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ad7b71d9-68f8-417c-bb98-ab015695b039 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:53.647784 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ad7b71d9-68f8-417c-bb98-ab015695b039 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:53.648231 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ad7b71d9-68f8-417c-bb98-ab015695b039 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:53.648955 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ad7b71d9-68f8-417c-bb98-ab015695b039 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:53.654943 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ad7b71d9-68f8-417c-bb98-ab015695b039 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:53.654943 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ad7b71d9-68f8-417c-bb98-ab015695b039 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:53.802389 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-a07a2c1c-eb03-4a82-b2d5-470424992fd6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:53.802672 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-a07a2c1c-eb03-4a82-b2d5-470424992fd6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:53.810282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a07a2c1c-eb03-4a82-b2d5-470424992fd6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:53.810833 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a07a2c1c-eb03-4a82-b2d5-470424992fd6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:53.811274 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a07a2c1c-eb03-4a82-b2d5-470424992fd6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:53.811974 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a07a2c1c-eb03-4a82-b2d5-470424992fd6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:53.813941 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a07a2c1c-eb03-4a82-b2d5-470424992fd6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:53.814406 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a07a2c1c-eb03-4a82-b2d5-470424992fd6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:53.848335 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a07a2c1c-eb03-4a82-b2d5-470424992fd6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:53.848917 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a07a2c1c-eb03-4a82-b2d5-470424992fd6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:53.849420 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a07a2c1c-eb03-4a82-b2d5-470424992fd6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:53.849939 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.objects.instance [None req-a07a2c1c-eb03-4a82-b2d5-470424992fd6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lazy-loading 'fault' on Instance uuid 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 {{(pid=118314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:25:53.912200 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ad7b71d9-68f8-417c-bb98-ab015695b039 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:53.919846 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a07a2c1c-eb03-4a82-b2d5-470424992fd6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f8e315028640a7a2106c23018bf158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab313819a4b141fc8391e750896f8b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:53.928922 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ad7b71d9-68f8-417c-bb98-ab015695b039 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:53.929888 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-a07a2c1c-eb03-4a82-b2d5-470424992fd6 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 200 len: 1225 microversion: 2.1 time: 0.133067 Aug 09 18:25:53.930593 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ad7b71d9-68f8-417c-bb98-ab015695b039 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:53.930932 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 457/935] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:53 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 1225 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:25:53.936239 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-ad7b71d9-68f8-417c-bb98-ab015695b039 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1730 microversion: 2.20 time: 0.302285 Aug 09 18:25:53.938098 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 479/936] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:53 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1730 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:53.990646 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-1c3c41b1-db37-4a07-8d2b-9035751ba3d8 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:53.994577 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-1c3c41b1-db37-4a07-8d2b-9035751ba3d8 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:54.000773 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1c3c41b1-db37-4a07-8d2b-9035751ba3d8 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:54.001766 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1c3c41b1-db37-4a07-8d2b-9035751ba3d8 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:54.002392 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1c3c41b1-db37-4a07-8d2b-9035751ba3d8 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:54.003295 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1c3c41b1-db37-4a07-8d2b-9035751ba3d8 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:54.003753 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1c3c41b1-db37-4a07-8d2b-9035751ba3d8 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:54.004182 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1c3c41b1-db37-4a07-8d2b-9035751ba3d8 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:54.035786 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-1c3c41b1-db37-4a07-8d2b-9035751ba3d8 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049129 Aug 09 18:25:54.041450 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 458/937] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Aug 9 18:25:53 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:25:54.952177 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2b7059b2-cbeb-42c1-bb1b-876137b21d34 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:54.952786 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-2b7059b2-cbeb-42c1-bb1b-876137b21d34 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] [instance: 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:54.960376 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2b7059b2-cbeb-42c1-bb1b-876137b21d34 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:54.960865 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2b7059b2-cbeb-42c1-bb1b-876137b21d34 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:54.961228 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-16d6c025-b0be-43f2-9a61-64b083c13e33 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:54.961647 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2b7059b2-cbeb-42c1-bb1b-876137b21d34 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:54.961864 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-16d6c025-b0be-43f2-9a61-64b083c13e33 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:54.962014 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2b7059b2-cbeb-42c1-bb1b-876137b21d34 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:54.962428 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2b7059b2-cbeb-42c1-bb1b-876137b21d34 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:54.962886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2b7059b2-cbeb-42c1-bb1b-876137b21d34 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:54.967683 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-16d6c025-b0be-43f2-9a61-64b083c13e33 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:54.968157 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-16d6c025-b0be-43f2-9a61-64b083c13e33 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:54.968583 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-16d6c025-b0be-43f2-9a61-64b083c13e33 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:54.969972 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-16d6c025-b0be-43f2-9a61-64b083c13e33 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:54.970423 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-16d6c025-b0be-43f2-9a61-64b083c13e33 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:54.970866 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-16d6c025-b0be-43f2-9a61-64b083c13e33 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:54.977077 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-2b7059b2-cbeb-42c1-bb1b-876137b21d34 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] HTTP exception thrown: Instance 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 could not be found. Aug 09 18:25:54.978751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2b7059b2-cbeb-42c1-bb1b-876137b21d34 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Request method failure captured: Aug 09 18:25:54.978751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 HTTP/1.1 Aug 09 18:25:54.978751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:25:54.978751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:25:54.978751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:25:54.978751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:25:54.978751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:25:54.978751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:25:54.978751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:25:54.978751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:25:54.978751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qUYfTcwJhVa9fJTScksU7RbX4ryGdXB-YKIKR9fvjav9C_yIzmKEmlVwrQbW2qfC3XJWedCdMJeYkPf3mA7g8Dh_wJ-C30Tbta7nZPWEjXbcO5yVyVmwxMhxNH-Bm5QMqb3c8EAWSPeBlF51TRiX_-sS5P-tM6D-l6jBwooGvFUqEI Aug 09 18:25:54.978751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:25:54.978751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:25:54.978751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:25:54.978751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:25:54.978751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:25:54.978751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:25:54.978751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: ab313819a4b141fc8391e750896f8b33 Aug 09 18:25:54.978751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-TestShelveInstance-902723644 Aug 09 18:25:54.978751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:25:54.978751 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:25:54.980363 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ab313819a4b141fc8391e750896f8b33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ab313819a4b141fc8391e750896f8b33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ab313819a4b141fc8391e750896f8b33", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ab313819a4b141fc8391e750896f8b33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:25:54.980363 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-TestShelveInstance-902723644 Aug 09 18:25:54.980363 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: ab313819a4b141fc8391e750896f8b33 Aug 09 18:25:54.980363 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-TestShelveInstance-902723644 Aug 09 18:25:54.980363 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-TestShelveInstance-902723644-project Aug 09 18:25:54.980363 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:25:54.980363 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:25:54.980363 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: 46f8e315028640a7a2106c23018bf158 Aug 09 18:25:54.980363 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-TestShelveInstance-902723644-project Aug 09 18:25:54.980363 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:25:54.980363 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Instance 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 could not be found. Aug 09 18:25:54.980363 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': '4979ac5e-c9e0-4028-8bfe-e928f34a6bf0'} Aug 09 18:25:54.981241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:25:54.981241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:25:54.981241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:25:54.981241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:25:54.981241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:25:54.981241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:25:54.981241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:25:54.981241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:25:54.981241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:25:54.981241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:25:54.981241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 could not be found. Aug 09 18:25:54.981241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:25:54.981241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:25:54.981241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:25:54.981241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:25:54.981241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:25:54.981241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:25:54.981241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:25:54.981241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:25:54.981241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:25:54.982632 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:25:54.982632 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:25:54.982632 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:25:54.982632 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:25:54.982632 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:25:54.982632 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:25:54.982632 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:25:54.982632 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 could not be found. Aug 09 18:25:54.982632 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:25:54.982632 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:25:54.982632 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:25:54.982632 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:25:54.982632 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:25:54.982632 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:25:54.982632 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:25:54.982632 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:25:54.982632 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 could not be found. Aug 09 18:25:54.982632 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:25:54.984078 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2b7059b2-cbeb-42c1-bb1b-876137b21d34 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Returning 404 to user: Instance 4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:25:54.984078 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-2b7059b2-cbeb-42c1-bb1b-876137b21d34 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0" status: 404 len: 111 microversion: 2.1 time: 0.031895 Aug 09 18:25:54.984078 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 480/938] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:54 2022] GET /compute/v2.1/servers/4979ac5e-c9e0-4028-8bfe-e928f34a6bf0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:25:55.049177 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f94ade30-f706-4f3e-9ca9-e94579237e6d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:55.051370 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f94ade30-f706-4f3e-9ca9-e94579237e6d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:55.057527 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f94ade30-f706-4f3e-9ca9-e94579237e6d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:55.058029 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f94ade30-f706-4f3e-9ca9-e94579237e6d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:55.058464 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f94ade30-f706-4f3e-9ca9-e94579237e6d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:55.059214 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f94ade30-f706-4f3e-9ca9-e94579237e6d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:55.059665 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f94ade30-f706-4f3e-9ca9-e94579237e6d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:55.060084 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f94ade30-f706-4f3e-9ca9-e94579237e6d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:55.092360 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f94ade30-f706-4f3e-9ca9-e94579237e6d tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047479 Aug 09 18:25:55.093122 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 481/939] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Aug 9 18:25:55 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 18:25:55.105989 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5d3e03a8-fb9e-49e9-ab56-0f55d92dc9c1 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:55.106655 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-5d3e03a8-fb9e-49e9-ab56-0f55d92dc9c1 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:55.113692 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5d3e03a8-fb9e-49e9-ab56-0f55d92dc9c1 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:55.114404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5d3e03a8-fb9e-49e9-ab56-0f55d92dc9c1 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:55.115148 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5d3e03a8-fb9e-49e9-ab56-0f55d92dc9c1 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:55.116121 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5d3e03a8-fb9e-49e9-ab56-0f55d92dc9c1 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:55.116775 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5d3e03a8-fb9e-49e9-ab56-0f55d92dc9c1 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:55.117421 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5d3e03a8-fb9e-49e9-ab56-0f55d92dc9c1 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:55.163328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-16d6c025-b0be-43f2-9a61-64b083c13e33 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:55.173249 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-16d6c025-b0be-43f2-9a61-64b083c13e33 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:55.175282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-16d6c025-b0be-43f2-9a61-64b083c13e33 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:55.176607 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-16d6c025-b0be-43f2-9a61-64b083c13e33 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1730 microversion: 2.20 time: 0.219339 Aug 09 18:25:55.177541 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 459/940] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:54 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1730 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 18:25:55.198369 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-5d3e03a8-fb9e-49e9-ab56-0f55d92dc9c1 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] HTTP exception thrown: Instance 641782b3-69ae-49c4-bc58-608cf91d08f8 is not attached to volume 936a5271-864e-4152-a322-84f2cfb8d3ac Aug 09 18:25:55.200677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5d3e03a8-fb9e-49e9-ab56-0f55d92dc9c1 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Request method failure captured: Aug 09 18:25:55.200677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: DELETE /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8/os-volume_attachments/936a5271-864e-4152-a322-84f2cfb8d3ac HTTP/1.1 Aug 09 18:25:55.200677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:25:55.200677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:25:55.200677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:25:55.200677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:25:55.200677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:25:55.200677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:25:55.200677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:25:55.200677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:25:55.200677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qXXI49HzNzVIFjR0JVq9jx2KFqicqN1hJrrdM79b_LeIJ83nykIU4SJ1qj20zBwxJgjYTDnr5MO7vxGBkwpTjsWdBPlcZuX5uBmH1BcIV7BSuSiDvrITgokJRV2_3OxCYuKSpGJsOF4z7VOTvX8BIDwgX4uJiR8Fkj5yec4Vxi4G8U Aug 09 18:25:55.200677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:25:55.200677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:25:55.200677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:25:55.200677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:25:55.200677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:25:55.200677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:25:55.200677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: d793302181944f85ade371ded12ca4c4 Aug 09 18:25:55.200677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-TestMinimumBasicScenario-1477889176 Aug 09 18:25:55.200677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:25:55.200677 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:25:55.202332 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d793302181944f85ade371ded12ca4c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d793302181944f85ade371ded12ca4c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d793302181944f85ade371ded12ca4c4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d793302181944f85ade371ded12ca4c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:25:55.202332 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-TestMinimumBasicScenario-1477889176 Aug 09 18:25:55.202332 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: d793302181944f85ade371ded12ca4c4 Aug 09 18:25:55.202332 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1477889176 Aug 09 18:25:55.202332 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-TestMinimumBasicScenario-1477889176-project Aug 09 18:25:55.202332 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:25:55.202332 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:25:55.202332 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: 5f4eeae86db248a09f0725ca23ac6a9f Aug 09 18:25:55.202332 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-TestMinimumBasicScenario-1477889176-project Aug 09 18:25:55.202332 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:25:55.202332 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Instance 641782b3-69ae-49c4-bc58-608cf91d08f8 is not attached to volume 936a5271-864e-4152-a322-84f2cfb8d3ac Aug 09 18:25:55.204272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'server_id': '641782b3-69ae-49c4-bc58-608cf91d08f8', 'id': '936a5271-864e-4152-a322-84f2cfb8d3ac'} Aug 09 18:25:55.204272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:25:55.204272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:25:55.204272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 09 18:25:55.204272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 09 18:25:55.204272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:25:55.204272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:25:55.204272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 09 18:25:55.204272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 09 18:25:55.204272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 936a5271-864e-4152-a322-84f2cfb8d3ac. Aug 09 18:25:55.204272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:25:55.204272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:25:55.204272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:25:55.204272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:25:55.204272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:25:55.204272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:25:55.204272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:25:55.204272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:25:55.204272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:25:55.205435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:25:55.205435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 09 18:25:55.205435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 18:25:55.205435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 641782b3-69ae-49c4-bc58-608cf91d08f8 is not attached to volume 936a5271-864e-4152-a322-84f2cfb8d3ac Aug 09 18:25:55.205435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:25:55.205435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:25:55.205435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:25:55.205435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:25:55.205435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:25:55.205435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:25:55.205435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:25:55.205435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:25:55.205435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 641782b3-69ae-49c4-bc58-608cf91d08f8 is not attached to volume 936a5271-864e-4152-a322-84f2cfb8d3ac Aug 09 18:25:55.205435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:25:55.205435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5d3e03a8-fb9e-49e9-ab56-0f55d92dc9c1 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Returning 404 to user: Instance 641782b3-69ae-49c4-bc58-608cf91d08f8 is not attached to volume 936a5271-864e-4152-a322-84f2cfb8d3ac {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:25:55.207151 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-5d3e03a8-fb9e-49e9-ab56-0f55d92dc9c1 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "DELETE /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8/os-volume_attachments/936a5271-864e-4152-a322-84f2cfb8d3ac" status: 404 len: 154 microversion: 2.1 time: 0.101165 Aug 09 18:25:55.207151 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 482/941] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Aug 9 18:25:55 2022] DELETE /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8/os-volume_attachments/936a5271-864e-4152-a322-84f2cfb8d3ac => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:25:55.303680 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-052cba60-c9d1-4d1c-b811-f2b3b31e63e2 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] Calling method '.version_select at 0x7f4c352f3dc0>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:55.394606 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-052cba60-c9d1-4d1c-b811-f2b3b31e63e2 tempest-TestShelveInstance-902723644 tempest-TestShelveInstance-902723644-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1622559993" status: 202 len: 0 microversion: 2.1 time: 0.094809 Aug 09 18:25:55.395229 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 460/942] 10.222.0.36 () {58 vars in 1254 bytes} [Tue Aug 9 18:25:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1622559993 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:25:56.199765 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-41feb8b7-56e9-4acf-b170-ccea73b66084 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:56.203675 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-41feb8b7-56e9-4acf-b170-ccea73b66084 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:56.204113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:25:56.208759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-41feb8b7-56e9-4acf-b170-ccea73b66084 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:56.209248 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-41feb8b7-56e9-4acf-b170-ccea73b66084 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:56.209680 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-41feb8b7-56e9-4acf-b170-ccea73b66084 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:56.210373 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-41feb8b7-56e9-4acf-b170-ccea73b66084 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:56.210858 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-41feb8b7-56e9-4acf-b170-ccea73b66084 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:56.211279 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-41feb8b7-56e9-4acf-b170-ccea73b66084 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:56.501379 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-862cc0e8-e2cb-46f4-9946-3511caf6f3b3 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:56.501934 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-862cc0e8-e2cb-46f4-9946-3511caf6f3b3 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:56.509059 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-862cc0e8-e2cb-46f4-9946-3511caf6f3b3 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:56.509554 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-862cc0e8-e2cb-46f4-9946-3511caf6f3b3 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:56.509988 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-862cc0e8-e2cb-46f4-9946-3511caf6f3b3 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:56.510699 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-862cc0e8-e2cb-46f4-9946-3511caf6f3b3 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:56.511187 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-862cc0e8-e2cb-46f4-9946-3511caf6f3b3 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:56.511609 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-862cc0e8-e2cb-46f4-9946-3511caf6f3b3 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:56.540194 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-862cc0e8-e2cb-46f4-9946-3511caf6f3b3 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Going to try to terminate instance {{(pid=118314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:25:56.648899 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-41feb8b7-56e9-4acf-b170-ccea73b66084 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:56.657828 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-41feb8b7-56e9-4acf-b170-ccea73b66084 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:56.659551 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-41feb8b7-56e9-4acf-b170-ccea73b66084 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:56.660808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-41feb8b7-56e9-4acf-b170-ccea73b66084 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1730 microversion: 2.20 time: 0.465000 Aug 09 18:25:56.671055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 483/943] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:56 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1730 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:56.820649 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-862cc0e8-e2cb-46f4-9946-3511caf6f3b3 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "DELETE /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 204 len: 0 microversion: 2.1 time: 0.323444 Aug 09 18:25:56.823270 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 461/944] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:25:56 2022] DELETE /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:25:56.836341 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-bea73216-5ff8-49fe-a36e-23a975ab8f21 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:56.836963 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-bea73216-5ff8-49fe-a36e-23a975ab8f21 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:56.843210 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bea73216-5ff8-49fe-a36e-23a975ab8f21 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:56.843945 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bea73216-5ff8-49fe-a36e-23a975ab8f21 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:56.844571 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bea73216-5ff8-49fe-a36e-23a975ab8f21 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:56.845450 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bea73216-5ff8-49fe-a36e-23a975ab8f21 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:56.845915 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bea73216-5ff8-49fe-a36e-23a975ab8f21 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:56.846334 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bea73216-5ff8-49fe-a36e-23a975ab8f21 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:57.088923 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-bea73216-5ff8-49fe-a36e-23a975ab8f21 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:57.100666 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-bea73216-5ff8-49fe-a36e-23a975ab8f21 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1556 microversion: 2.1 time: 0.268485 Aug 09 18:25:57.106857 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 484/945] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:56 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1556 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:25:57.683917 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-3f813ce3-e59c-48e5-8c8b-00fcb033a38f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:57.684607 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-3f813ce3-e59c-48e5-8c8b-00fcb033a38f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:57.686997 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:25:57.692877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3f813ce3-e59c-48e5-8c8b-00fcb033a38f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:57.693379 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3f813ce3-e59c-48e5-8c8b-00fcb033a38f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:57.693816 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3f813ce3-e59c-48e5-8c8b-00fcb033a38f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:57.694528 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3f813ce3-e59c-48e5-8c8b-00fcb033a38f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:57.694985 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3f813ce3-e59c-48e5-8c8b-00fcb033a38f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:57.699864 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3f813ce3-e59c-48e5-8c8b-00fcb033a38f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:57.922932 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-3f813ce3-e59c-48e5-8c8b-00fcb033a38f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:57.936611 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-3f813ce3-e59c-48e5-8c8b-00fcb033a38f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:57.938802 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-3f813ce3-e59c-48e5-8c8b-00fcb033a38f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:57.939978 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-3f813ce3-e59c-48e5-8c8b-00fcb033a38f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1730 microversion: 2.20 time: 0.260406 Aug 09 18:25:57.940540 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 462/946] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:57 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1730 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:58.122421 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-80d2b0cf-59c5-4c13-98dc-33791e5e2a01 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:58.123057 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-80d2b0cf-59c5-4c13-98dc-33791e5e2a01 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:58.129716 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-80d2b0cf-59c5-4c13-98dc-33791e5e2a01 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:58.130194 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-80d2b0cf-59c5-4c13-98dc-33791e5e2a01 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:58.130626 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-80d2b0cf-59c5-4c13-98dc-33791e5e2a01 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:58.131337 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-80d2b0cf-59c5-4c13-98dc-33791e5e2a01 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:58.131788 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-80d2b0cf-59c5-4c13-98dc-33791e5e2a01 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:58.132209 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-80d2b0cf-59c5-4c13-98dc-33791e5e2a01 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:58.400824 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-80d2b0cf-59c5-4c13-98dc-33791e5e2a01 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:58.409310 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-80d2b0cf-59c5-4c13-98dc-33791e5e2a01 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1556 microversion: 2.1 time: 0.290664 Aug 09 18:25:58.409898 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 485/947] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:58 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1556 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:25:58.964153 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-653aa9b9-93dd-4388-b037-8f11a3f06685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:58.965456 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-653aa9b9-93dd-4388-b037-8f11a3f06685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:58.972885 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-653aa9b9-93dd-4388-b037-8f11a3f06685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:58.973668 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-653aa9b9-93dd-4388-b037-8f11a3f06685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:58.975081 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-653aa9b9-93dd-4388-b037-8f11a3f06685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:58.975843 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-653aa9b9-93dd-4388-b037-8f11a3f06685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:58.976496 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-653aa9b9-93dd-4388-b037-8f11a3f06685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:58.976937 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-653aa9b9-93dd-4388-b037-8f11a3f06685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:59.270148 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-653aa9b9-93dd-4388-b037-8f11a3f06685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:59.278599 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-653aa9b9-93dd-4388-b037-8f11a3f06685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:59.280256 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-653aa9b9-93dd-4388-b037-8f11a3f06685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:59.282187 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-653aa9b9-93dd-4388-b037-8f11a3f06685 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1717 microversion: 2.20 time: 0.322298 Aug 09 18:25:59.282842 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 463/948] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:25:58 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1717 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:25:59.433494 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-76ddfec7-2deb-4a8a-ae24-ebe16a764c14 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:59.434326 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-76ddfec7-2deb-4a8a-ae24-ebe16a764c14 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:59.441330 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-76ddfec7-2deb-4a8a-ae24-ebe16a764c14 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:59.442828 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-76ddfec7-2deb-4a8a-ae24-ebe16a764c14 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:59.442828 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-76ddfec7-2deb-4a8a-ae24-ebe16a764c14 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:59.443249 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-76ddfec7-2deb-4a8a-ae24-ebe16a764c14 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:59.443784 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-76ddfec7-2deb-4a8a-ae24-ebe16a764c14 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:59.444280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-76ddfec7-2deb-4a8a-ae24-ebe16a764c14 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:59.699996 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-05e3e777-5be3-4e3e-87e8-22dff2737205 req-403bc117-7a43-483c-900f-cd1f7dd23211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "641782b3-69ae-49c4-bc58-608cf91d08f8", "name": "network-vif-deleted", "tag": "6517c4a8-4f1c-427c-b492-618a0970aaef"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:25:59.709693 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-05e3e777-5be3-4e3e-87e8-22dff2737205 req-403bc117-7a43-483c-900f-cd1f7dd23211 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:59.710538 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-05e3e777-5be3-4e3e-87e8-22dff2737205 req-403bc117-7a43-483c-900f-cd1f7dd23211 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:59.711152 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-05e3e777-5be3-4e3e-87e8-22dff2737205 req-403bc117-7a43-483c-900f-cd1f7dd23211 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:59.724422 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-05e3e777-5be3-4e3e-87e8-22dff2737205 req-403bc117-7a43-483c-900f-cd1f7dd23211 service nova] Creating event network-vif-deleted:6517c4a8-4f1c-427c-b492-618a0970aaef for instance 641782b3-69ae-49c4-bc58-608cf91d08f8 on hv-cinder-79797 Aug 09 18:25:59.729454 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-05e3e777-5be3-4e3e-87e8-22dff2737205 req-403bc117-7a43-483c-900f-cd1f7dd23211 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034206 Aug 09 18:25:59.730313 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 464/949] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:25:59.760939 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-76ddfec7-2deb-4a8a-ae24-ebe16a764c14 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4eeae86db248a09f0725ca23ac6a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd793302181944f85ade371ded12ca4c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:59.770098 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-76ddfec7-2deb-4a8a-ae24-ebe16a764c14 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 200 len: 1556 microversion: 2.1 time: 0.342151 Aug 09 18:25:59.773085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 486/950] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:59 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 1556 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:26:00.792597 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-442eb074-af13-4dca-9f1e-3bb087d9972f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:00.793324 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-442eb074-af13-4dca-9f1e-3bb087d9972f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] [instance: 641782b3-69ae-49c4-bc58-608cf91d08f8] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:00.799623 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-442eb074-af13-4dca-9f1e-3bb087d9972f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:00.800159 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-442eb074-af13-4dca-9f1e-3bb087d9972f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:00.800540 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-442eb074-af13-4dca-9f1e-3bb087d9972f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:00.801225 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-442eb074-af13-4dca-9f1e-3bb087d9972f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:00.801673 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-442eb074-af13-4dca-9f1e-3bb087d9972f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:00.802211 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-442eb074-af13-4dca-9f1e-3bb087d9972f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:00.816376 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-442eb074-af13-4dca-9f1e-3bb087d9972f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] HTTP exception thrown: Instance 641782b3-69ae-49c4-bc58-608cf91d08f8 could not be found. Aug 09 18:26:00.818019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-442eb074-af13-4dca-9f1e-3bb087d9972f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Request method failure captured: Aug 09 18:26:00.818019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 HTTP/1.1 Aug 09 18:26:00.818019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:26:00.818019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:26:00.818019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:26:00.818019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 0 Aug 09 18:26:00.818019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:26:00.818019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:26:00.818019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:26:00.818019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:26:00.818019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qXXI49HzNzVIFjR0JVq9jx2KFqicqN1hJrrdM79b_LeIJ83nykIU4SJ1qj20zBwxJgjYTDnr5MO7vxGBkwpTjsWdBPlcZuX5uBmH1BcIV7BSuSiDvrITgokJRV2_3OxCYuKSpGJsOF4z7VOTvX8BIDwgX4uJiR8Fkj5yec4Vxi4G8U Aug 09 18:26:00.818019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:26:00.818019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:26:00.818019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:26:00.818019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:26:00.818019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:26:00.818019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:26:00.818019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: d793302181944f85ade371ded12ca4c4 Aug 09 18:26:00.818019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-TestMinimumBasicScenario-1477889176 Aug 09 18:26:00.818019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:26:00.818019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:26:00.819681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d793302181944f85ade371ded12ca4c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d793302181944f85ade371ded12ca4c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d793302181944f85ade371ded12ca4c4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d793302181944f85ade371ded12ca4c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:26:00.819681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-TestMinimumBasicScenario-1477889176 Aug 09 18:26:00.819681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: d793302181944f85ade371ded12ca4c4 Aug 09 18:26:00.819681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1477889176 Aug 09 18:26:00.819681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-TestMinimumBasicScenario-1477889176-project Aug 09 18:26:00.819681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:26:00.819681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:26:00.819681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: 5f4eeae86db248a09f0725ca23ac6a9f Aug 09 18:26:00.819681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-TestMinimumBasicScenario-1477889176-project Aug 09 18:26:00.819681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: > Aug 09 18:26:00.819681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Instance 641782b3-69ae-49c4-bc58-608cf91d08f8 could not be found. Aug 09 18:26:00.819681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'id': '641782b3-69ae-49c4-bc58-608cf91d08f8'} Aug 09 18:26:00.823736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:26:00.823736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:00.823736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:26:00.823736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:26:00.823736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:26:00.823736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:26:00.823736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:26:00.823736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:26:00.823736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:26:00.823736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:26:00.823736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 641782b3-69ae-49c4-bc58-608cf91d08f8 could not be found. Aug 09 18:26:00.823736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:00.823736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:26:00.823736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:00.823736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:00.823736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:26:00.823736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:26:00.823736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:26:00.823736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:26:00.823736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:26:00.825262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:26:00.825262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:26:00.825262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:26:00.825262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:26:00.825262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:26:00.825262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:26:00.825262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:26:00.825262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 641782b3-69ae-49c4-bc58-608cf91d08f8 could not be found. Aug 09 18:26:00.825262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:00.825262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:26:00.825262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:00.825262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:00.825262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:26:00.825262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:26:00.825262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:26:00.825262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:26:00.825262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 641782b3-69ae-49c4-bc58-608cf91d08f8 could not be found. Aug 09 18:26:00.825262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:00.826572 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-442eb074-af13-4dca-9f1e-3bb087d9972f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Returning 404 to user: Instance 641782b3-69ae-49c4-bc58-608cf91d08f8 could not be found. {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:26:00.826572 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-442eb074-af13-4dca-9f1e-3bb087d9972f tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8" status: 404 len: 111 microversion: 2.1 time: 0.031814 Aug 09 18:26:00.826572 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 465/951] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:00 2022] GET /compute/v2.1/servers/641782b3-69ae-49c4-bc58-608cf91d08f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:26:00.829444 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-7111a281-c96f-45e5-a791-fc7260e33633 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] Calling method '.version_select at 0x7f4c354ad160>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:00.920166 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-7111a281-c96f-45e5-a791-fc7260e33633 tempest-TestMinimumBasicScenario-1477889176 tempest-TestMinimumBasicScenario-1477889176-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1160722648" status: 202 len: 0 microversion: 2.1 time: 0.095579 Aug 09 18:26:00.921364 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 487/952] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Aug 9 18:26:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1160722648 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:26:04.720057 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-44f44a90-8e2a-4dfd-8a11-23fb11206f68 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:04.720660 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-44f44a90-8e2a-4dfd-8a11-23fb11206f68 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:04.727654 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-44f44a90-8e2a-4dfd-8a11-23fb11206f68 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:04.728145 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-44f44a90-8e2a-4dfd-8a11-23fb11206f68 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:04.734648 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-44f44a90-8e2a-4dfd-8a11-23fb11206f68 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:04.734648 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-44f44a90-8e2a-4dfd-8a11-23fb11206f68 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:04.734648 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-44f44a90-8e2a-4dfd-8a11-23fb11206f68 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:04.734648 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-44f44a90-8e2a-4dfd-8a11-23fb11206f68 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:04.754042 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-44f44a90-8e2a-4dfd-8a11-23fb11206f68 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/ips" status: 200 len: 147 microversion: 2.1 time: 0.038634 Aug 09 18:26:04.754615 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 466/953] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Aug 9 18:26:04 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/ips => generated 147 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:26:06.544285 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f510e4b1-21cf-4e8d-8e90-da17cd6a7a01 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1843000-7f6b-4070-bc37-0018fdf01d5b"}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:26:06.546726 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f510e4b1-21cf-4e8d-8e90-da17cd6a7a01 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:06.553721 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f510e4b1-21cf-4e8d-8e90-da17cd6a7a01 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:06.554241 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f510e4b1-21cf-4e8d-8e90-da17cd6a7a01 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:06.554836 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f510e4b1-21cf-4e8d-8e90-da17cd6a7a01 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:06.555574 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f510e4b1-21cf-4e8d-8e90-da17cd6a7a01 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:06.556063 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f510e4b1-21cf-4e8d-8e90-da17cd6a7a01 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:06.556490 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f510e4b1-21cf-4e8d-8e90-da17cd6a7a01 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:07.419807 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f510e4b1-21cf-4e8d-8e90-da17cd6a7a01 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "POST /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.879574 Aug 09 18:26:07.420388 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 488/954] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Aug 9 18:26:06 2022] POST /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-volume_attachments => generated 194 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:26:14.978487 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d3cc879f-069f-4606-8f29-76ed20d892cc tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:14.980669 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d3cc879f-069f-4606-8f29-76ed20d892cc tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:14.983518 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=9 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:26:14.984630 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:26:14.989226 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d3cc879f-069f-4606-8f29-76ed20d892cc tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:14.989713 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d3cc879f-069f-4606-8f29-76ed20d892cc tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:14.990185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d3cc879f-069f-4606-8f29-76ed20d892cc tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:14.990907 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d3cc879f-069f-4606-8f29-76ed20d892cc tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:14.991361 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d3cc879f-069f-4606-8f29-76ed20d892cc tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:14.995731 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d3cc879f-069f-4606-8f29-76ed20d892cc tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:15.020880 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d3cc879f-069f-4606-8f29-76ed20d892cc tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046252 Aug 09 18:26:15.024402 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 467/955] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Aug 9 18:26:14 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:26:15.033806 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-bae6870d-68de-4973-a844-552e5178c0e0 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:15.034385 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-bae6870d-68de-4973-a844-552e5178c0e0 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:15.041263 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bae6870d-68de-4973-a844-552e5178c0e0 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:15.041869 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bae6870d-68de-4973-a844-552e5178c0e0 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:15.042305 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bae6870d-68de-4973-a844-552e5178c0e0 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:15.043016 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bae6870d-68de-4973-a844-552e5178c0e0 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:15.043466 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bae6870d-68de-4973-a844-552e5178c0e0 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:15.043886 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bae6870d-68de-4973-a844-552e5178c0e0 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:15.072146 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-bae6870d-68de-4973-a844-552e5178c0e0 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-volume_attachments/d1843000-7f6b-4070-bc37-0018fdf01d5b" status: 200 len: 194 microversion: 2.1 time: 0.044047 Aug 09 18:26:15.072715 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 489/956] 10.222.0.36 () {58 vars in 1413 bytes} [Tue Aug 9 18:26:15 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-volume_attachments/d1843000-7f6b-4070-bc37-0018fdf01d5b => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:26:16.636070 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-663acc25-3e24-411e-bec6-463435dab46a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "959ba290-bd57-4c70-b323-d60a33397e60"}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:26:16.638420 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-663acc25-3e24-411e-bec6-463435dab46a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:16.645607 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-663acc25-3e24-411e-bec6-463435dab46a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:16.646140 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-663acc25-3e24-411e-bec6-463435dab46a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:16.646583 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-663acc25-3e24-411e-bec6-463435dab46a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:16.647300 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-663acc25-3e24-411e-bec6-463435dab46a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:16.647759 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-663acc25-3e24-411e-bec6-463435dab46a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:16.648184 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-663acc25-3e24-411e-bec6-463435dab46a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:17.305120 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-663acc25-3e24-411e-bec6-463435dab46a tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "POST /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.673228 Aug 09 18:26:17.305742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 468/957] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Aug 9 18:26:16 2022] POST /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-volume_attachments => generated 194 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:26:24.832668 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-cbff84df-4c38-4aef-b349-305158104c93 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:24.834956 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-cbff84df-4c38-4aef-b349-305158104c93 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:24.841363 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cbff84df-4c38-4aef-b349-305158104c93 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:24.841843 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cbff84df-4c38-4aef-b349-305158104c93 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:24.842277 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cbff84df-4c38-4aef-b349-305158104c93 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:24.843668 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cbff84df-4c38-4aef-b349-305158104c93 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:24.844435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cbff84df-4c38-4aef-b349-305158104c93 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:24.844864 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cbff84df-4c38-4aef-b349-305158104c93 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:24.847320 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:26:24.875084 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-cbff84df-4c38-4aef-b349-305158104c93 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046223 Aug 09 18:26:24.875657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 490/958] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Aug 9 18:26:24 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:26:25.017126 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-12c3be83-290a-4bf8-bec3-dcf61c319dd4 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:25.017733 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-12c3be83-290a-4bf8-bec3-dcf61c319dd4 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:25.023892 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-12c3be83-290a-4bf8-bec3-dcf61c319dd4 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:25.024375 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-12c3be83-290a-4bf8-bec3-dcf61c319dd4 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:25.024814 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-12c3be83-290a-4bf8-bec3-dcf61c319dd4 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:25.025494 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-12c3be83-290a-4bf8-bec3-dcf61c319dd4 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:25.025977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-12c3be83-290a-4bf8-bec3-dcf61c319dd4 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:25.026398 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-12c3be83-290a-4bf8-bec3-dcf61c319dd4 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:25.054507 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-12c3be83-290a-4bf8-bec3-dcf61c319dd4 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-volume_attachments/d1843000-7f6b-4070-bc37-0018fdf01d5b" status: 200 len: 194 microversion: 2.1 time: 0.042867 Aug 09 18:26:25.055111 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 469/959] 10.222.0.36 () {58 vars in 1413 bytes} [Tue Aug 9 18:26:25 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-volume_attachments/d1843000-7f6b-4070-bc37-0018fdf01d5b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:26:25.066762 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e58c9b26-c2fd-463d-a3dd-565cfed1b213 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:25.067255 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e58c9b26-c2fd-463d-a3dd-565cfed1b213 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:25.073220 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e58c9b26-c2fd-463d-a3dd-565cfed1b213 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:25.073879 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e58c9b26-c2fd-463d-a3dd-565cfed1b213 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:25.074323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e58c9b26-c2fd-463d-a3dd-565cfed1b213 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:25.075041 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e58c9b26-c2fd-463d-a3dd-565cfed1b213 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:25.075488 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e58c9b26-c2fd-463d-a3dd-565cfed1b213 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:25.075911 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e58c9b26-c2fd-463d-a3dd-565cfed1b213 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:25.157802 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.objects.instance [None req-e58c9b26-c2fd-463d-a3dd-565cfed1b213 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lazy-loading 'services' on Instance uuid b2380477-dae7-428a-a5ba-ee0b14d8e91e {{(pid=118313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:26:25.375277 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e58c9b26-c2fd-463d-a3dd-565cfed1b213 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-volume_attachments/d1843000-7f6b-4070-bc37-0018fdf01d5b" status: 202 len: 0 microversion: 2.1 time: 0.313195 Aug 09 18:26:25.375871 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 491/960] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Aug 9 18:26:25 2022] DELETE /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-volume_attachments/d1843000-7f6b-4070-bc37-0018fdf01d5b => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:26:27.552519 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-687151d4-e2c4-4f3f-b4c1-8a03aa759079 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:27.553083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-687151d4-e2c4-4f3f-b4c1-8a03aa759079 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:27.558969 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-687151d4-e2c4-4f3f-b4c1-8a03aa759079 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:27.559443 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-687151d4-e2c4-4f3f-b4c1-8a03aa759079 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:27.559871 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-687151d4-e2c4-4f3f-b4c1-8a03aa759079 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:27.560543 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-687151d4-e2c4-4f3f-b4c1-8a03aa759079 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:27.560988 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-687151d4-e2c4-4f3f-b4c1-8a03aa759079 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:27.561407 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-687151d4-e2c4-4f3f-b4c1-8a03aa759079 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:27.591303 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-687151d4-e2c4-4f3f-b4c1-8a03aa759079 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-volume_attachments/959ba290-bd57-4c70-b323-d60a33397e60" status: 200 len: 194 microversion: 2.1 time: 0.042670 Aug 09 18:26:27.591878 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 470/961] 10.222.0.36 () {58 vars in 1413 bytes} [Tue Aug 9 18:26:27 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-volume_attachments/959ba290-bd57-4c70-b323-d60a33397e60 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:26:27.603965 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2c33ad95-fff5-4f5d-8da5-660fbf82ee3f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:27.604542 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-2c33ad95-fff5-4f5d-8da5-660fbf82ee3f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:27.606839 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:26:27.612663 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2c33ad95-fff5-4f5d-8da5-660fbf82ee3f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:27.613425 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2c33ad95-fff5-4f5d-8da5-660fbf82ee3f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:27.613859 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2c33ad95-fff5-4f5d-8da5-660fbf82ee3f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:27.614548 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2c33ad95-fff5-4f5d-8da5-660fbf82ee3f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:27.615034 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2c33ad95-fff5-4f5d-8da5-660fbf82ee3f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:27.615456 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2c33ad95-fff5-4f5d-8da5-660fbf82ee3f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:27.695115 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.objects.instance [None req-2c33ad95-fff5-4f5d-8da5-660fbf82ee3f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lazy-loading 'services' on Instance uuid b2380477-dae7-428a-a5ba-ee0b14d8e91e {{(pid=118313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:26:27.917556 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-2c33ad95-fff5-4f5d-8da5-660fbf82ee3f tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-volume_attachments/959ba290-bd57-4c70-b323-d60a33397e60" status: 202 len: 0 microversion: 2.1 time: 0.318124 Aug 09 18:26:27.918130 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 492/962] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Aug 9 18:26:27 2022] DELETE /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-volume_attachments/959ba290-bd57-4c70-b323-d60a33397e60 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:26:29.086621 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-db72f9a7-9325-465c-9da8-187441763caf tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:29.088892 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-db72f9a7-9325-465c-9da8-187441763caf tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:29.095163 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-db72f9a7-9325-465c-9da8-187441763caf tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:29.095646 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-db72f9a7-9325-465c-9da8-187441763caf tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:29.096079 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-db72f9a7-9325-465c-9da8-187441763caf tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:29.096771 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-db72f9a7-9325-465c-9da8-187441763caf tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:29.097226 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-db72f9a7-9325-465c-9da8-187441763caf tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:29.097648 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-db72f9a7-9325-465c-9da8-187441763caf tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:29.126428 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-db72f9a7-9325-465c-9da8-187441763caf tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043677 Aug 09 18:26:29.127018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 471/963] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Aug 9 18:26:29 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 18:26:29.240078 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-4106c154-b2ef-42b5-8204-e25fcfcd9143 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:29.242298 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-4106c154-b2ef-42b5-8204-e25fcfcd9143 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:29.248337 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4106c154-b2ef-42b5-8204-e25fcfcd9143 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:29.248835 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4106c154-b2ef-42b5-8204-e25fcfcd9143 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:29.249380 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4106c154-b2ef-42b5-8204-e25fcfcd9143 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:29.250141 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4106c154-b2ef-42b5-8204-e25fcfcd9143 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:29.250596 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4106c154-b2ef-42b5-8204-e25fcfcd9143 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:29.251045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4106c154-b2ef-42b5-8204-e25fcfcd9143 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:29.278825 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-4106c154-b2ef-42b5-8204-e25fcfcd9143 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043369 Aug 09 18:26:29.279305 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 493/964] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Aug 9 18:26:29 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 18:26:29.340644 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-0de22061-4200-4e50-933e-a7b70084b4a0 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:29.341168 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-0de22061-4200-4e50-933e-a7b70084b4a0 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:29.347742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0de22061-4200-4e50-933e-a7b70084b4a0 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:29.348223 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0de22061-4200-4e50-933e-a7b70084b4a0 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:29.348667 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0de22061-4200-4e50-933e-a7b70084b4a0 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:29.349351 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0de22061-4200-4e50-933e-a7b70084b4a0 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:29.349805 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0de22061-4200-4e50-933e-a7b70084b4a0 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:29.350229 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0de22061-4200-4e50-933e-a7b70084b4a0 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:29.374804 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-0de22061-4200-4e50-933e-a7b70084b4a0 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Going to try to terminate instance {{(pid=118314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:26:29.660035 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-0de22061-4200-4e50-933e-a7b70084b4a0 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e" status: 204 len: 0 microversion: 2.1 time: 0.322794 Aug 09 18:26:29.660572 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 472/965] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:26:29 2022] DELETE /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:26:29.668648 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-84dd5c11-fc6f-44cd-8230-b3ea47bb88fd tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:29.669258 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-84dd5c11-fc6f-44cd-8230-b3ea47bb88fd tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:29.675165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-84dd5c11-fc6f-44cd-8230-b3ea47bb88fd tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:29.675656 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-84dd5c11-fc6f-44cd-8230-b3ea47bb88fd tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:29.676096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-84dd5c11-fc6f-44cd-8230-b3ea47bb88fd tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:29.676810 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-84dd5c11-fc6f-44cd-8230-b3ea47bb88fd tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:29.677363 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-84dd5c11-fc6f-44cd-8230-b3ea47bb88fd tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:29.677797 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-84dd5c11-fc6f-44cd-8230-b3ea47bb88fd tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:29.806599 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-84dd5c11-fc6f-44cd-8230-b3ea47bb88fd tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:29.814849 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-84dd5c11-fc6f-44cd-8230-b3ea47bb88fd tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e" status: 200 len: 1674 microversion: 2.1 time: 0.150045 Aug 09 18:26:29.815422 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 494/966] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:29 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:26:30.836386 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-ca3e2574-95fa-48c7-8a22-1a186bafc54e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:30.837083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-ca3e2574-95fa-48c7-8a22-1a186bafc54e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:30.844395 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ca3e2574-95fa-48c7-8a22-1a186bafc54e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:30.844880 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ca3e2574-95fa-48c7-8a22-1a186bafc54e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:30.845316 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ca3e2574-95fa-48c7-8a22-1a186bafc54e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:30.846015 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ca3e2574-95fa-48c7-8a22-1a186bafc54e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:30.846472 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ca3e2574-95fa-48c7-8a22-1a186bafc54e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:30.846927 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-ca3e2574-95fa-48c7-8a22-1a186bafc54e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:30.980169 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-ca3e2574-95fa-48c7-8a22-1a186bafc54e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:30.987895 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-ca3e2574-95fa-48c7-8a22-1a186bafc54e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e" status: 200 len: 1674 microversion: 2.1 time: 0.155699 Aug 09 18:26:30.988455 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 473/967] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:30 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:26:32.009255 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9b9ff731-eff2-4e56-a3a0-cdd9ba3ef373 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:32.009858 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9b9ff731-eff2-4e56-a3a0-cdd9ba3ef373 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:32.016184 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9b9ff731-eff2-4e56-a3a0-cdd9ba3ef373 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:32.016673 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9b9ff731-eff2-4e56-a3a0-cdd9ba3ef373 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:32.017110 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9b9ff731-eff2-4e56-a3a0-cdd9ba3ef373 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:32.017815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9b9ff731-eff2-4e56-a3a0-cdd9ba3ef373 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:32.018268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9b9ff731-eff2-4e56-a3a0-cdd9ba3ef373 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:32.018689 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9b9ff731-eff2-4e56-a3a0-cdd9ba3ef373 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:32.266263 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9b9ff731-eff2-4e56-a3a0-cdd9ba3ef373 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:32.273690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9b9ff731-eff2-4e56-a3a0-cdd9ba3ef373 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e" status: 200 len: 1674 microversion: 2.1 time: 0.268247 Aug 09 18:26:32.274271 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 495/968] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:32 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e => generated 1674 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:26:32.993755 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-a8c17a74-d8a8-4123-95fe-008aa93e05f9 req-8ef8f4a8-2f01-4059-85ba-b7ed06eae94c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2380477-dae7-428a-a5ba-ee0b14d8e91e", "name": "network-vif-deleted", "tag": "057b2422-5227-4c13-8c4d-5c89abcdb889"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:26:33.007463 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-a8c17a74-d8a8-4123-95fe-008aa93e05f9 req-8ef8f4a8-2f01-4059-85ba-b7ed06eae94c service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:33.007463 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-a8c17a74-d8a8-4123-95fe-008aa93e05f9 req-8ef8f4a8-2f01-4059-85ba-b7ed06eae94c service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:33.007463 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-a8c17a74-d8a8-4123-95fe-008aa93e05f9 req-8ef8f4a8-2f01-4059-85ba-b7ed06eae94c service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:33.017140 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-a8c17a74-d8a8-4123-95fe-008aa93e05f9 req-8ef8f4a8-2f01-4059-85ba-b7ed06eae94c service nova] Creating event network-vif-deleted:057b2422-5227-4c13-8c4d-5c89abcdb889 for instance b2380477-dae7-428a-a5ba-ee0b14d8e91e on hv-cinder-79797 Aug 09 18:26:33.022060 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-a8c17a74-d8a8-4123-95fe-008aa93e05f9 req-8ef8f4a8-2f01-4059-85ba-b7ed06eae94c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.253019 Aug 09 18:26:33.022659 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 474/969] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:26:33.295589 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-332583c8-5cdd-4bb5-8fed-15179815d57e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:33.296464 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-332583c8-5cdd-4bb5-8fed-15179815d57e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:33.302689 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-332583c8-5cdd-4bb5-8fed-15179815d57e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:33.303227 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-332583c8-5cdd-4bb5-8fed-15179815d57e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:33.303661 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-332583c8-5cdd-4bb5-8fed-15179815d57e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:33.304356 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-332583c8-5cdd-4bb5-8fed-15179815d57e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:33.304808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-332583c8-5cdd-4bb5-8fed-15179815d57e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:33.305226 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-332583c8-5cdd-4bb5-8fed-15179815d57e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:33.338608 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-332583c8-5cdd-4bb5-8fed-15179815d57e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:33.339189 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-332583c8-5cdd-4bb5-8fed-15179815d57e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:33.339623 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-332583c8-5cdd-4bb5-8fed-15179815d57e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:33.340062 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.objects.instance [None req-332583c8-5cdd-4bb5-8fed-15179815d57e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lazy-loading 'fault' on Instance uuid b2380477-dae7-428a-a5ba-ee0b14d8e91e {{(pid=118313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:26:33.381907 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-332583c8-5cdd-4bb5-8fed-15179815d57e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c7401eaf744ef895bacc294f7c6268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23fb97c7c4049c49f6bad8418fc4dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:33.389379 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-332583c8-5cdd-4bb5-8fed-15179815d57e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e" status: 200 len: 1326 microversion: 2.1 time: 0.097721 Aug 09 18:26:33.390792 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 496/970] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:33 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e => generated 1326 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:26:34.412515 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-daf0f818-fc66-4a13-9f3c-503bb8f7598e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:34.413236 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-daf0f818-fc66-4a13-9f3c-503bb8f7598e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:34.419288 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-daf0f818-fc66-4a13-9f3c-503bb8f7598e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:34.419766 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-daf0f818-fc66-4a13-9f3c-503bb8f7598e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:34.420194 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-daf0f818-fc66-4a13-9f3c-503bb8f7598e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:34.421510 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-daf0f818-fc66-4a13-9f3c-503bb8f7598e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:34.421964 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-daf0f818-fc66-4a13-9f3c-503bb8f7598e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:34.422381 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-daf0f818-fc66-4a13-9f3c-503bb8f7598e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:34.435314 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-daf0f818-fc66-4a13-9f3c-503bb8f7598e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] HTTP exception thrown: Instance b2380477-dae7-428a-a5ba-ee0b14d8e91e could not be found. Aug 09 18:26:34.436949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-daf0f818-fc66-4a13-9f3c-503bb8f7598e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Request method failure captured: Aug 09 18:26:34.436949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e HTTP/1.1 Aug 09 18:26:34.436949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:26:34.436949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:26:34.436949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:26:34.436949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 0 Aug 09 18:26:34.436949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:26:34.436949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:26:34.436949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:26:34.436949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:26:34.436949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qTBVqPk4pl3xjTXh-vq2d9g5Jblc0yO57MGdyZvr84ccuFN_X7CCb-PNCv6uJ_iAzgwKSL7HL9VzncoyOfgA5jaPc66FIOAMazSQ5UgccsSgTmgCY6KqelNNNA8rRkhbZigJN9qQGtEE7r-OFahXTOcT7uQMnCZlOVhfWLSifhlhoU Aug 09 18:26:34.436949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:26:34.436949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:26:34.436949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:26:34.436949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:26:34.436949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:26:34.436949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:26:34.436949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: b23fb97c7c4049c49f6bad8418fc4dec Aug 09 18:26:34.436949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-AttachVolumeTestJSON-1043964365 Aug 09 18:26:34.436949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:26:34.436949 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:26:34.438646 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b23fb97c7c4049c49f6bad8418fc4dec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b23fb97c7c4049c49f6bad8418fc4dec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b23fb97c7c4049c49f6bad8418fc4dec", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b23fb97c7c4049c49f6bad8418fc4dec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:26:34.438646 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-AttachVolumeTestJSON-1043964365 Aug 09 18:26:34.438646 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: b23fb97c7c4049c49f6bad8418fc4dec Aug 09 18:26:34.438646 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1043964365 Aug 09 18:26:34.438646 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-AttachVolumeTestJSON-1043964365-project Aug 09 18:26:34.438646 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:26:34.438646 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:26:34.438646 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: a6c7401eaf744ef895bacc294f7c6268 Aug 09 18:26:34.438646 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-AttachVolumeTestJSON-1043964365-project Aug 09 18:26:34.438646 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: > Aug 09 18:26:34.438646 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Instance b2380477-dae7-428a-a5ba-ee0b14d8e91e could not be found. Aug 09 18:26:34.438646 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'id': 'b2380477-dae7-428a-a5ba-ee0b14d8e91e'} Aug 09 18:26:34.439796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:26:34.439796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:34.439796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:26:34.439796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:26:34.439796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:26:34.439796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:26:34.439796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:26:34.439796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:26:34.439796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:26:34.439796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:26:34.439796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2380477-dae7-428a-a5ba-ee0b14d8e91e could not be found. Aug 09 18:26:34.439796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:34.439796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:26:34.439796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:34.439796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:34.439796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:26:34.439796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:26:34.439796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:26:34.439796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:26:34.439796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:26:34.441404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:26:34.441404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:26:34.441404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:26:34.441404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:26:34.441404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:26:34.441404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:26:34.441404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:26:34.441404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2380477-dae7-428a-a5ba-ee0b14d8e91e could not be found. Aug 09 18:26:34.441404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:34.441404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:26:34.441404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:34.441404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:34.441404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:26:34.441404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:26:34.441404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:26:34.441404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:26:34.441404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2380477-dae7-428a-a5ba-ee0b14d8e91e could not be found. Aug 09 18:26:34.441404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:34.442898 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-daf0f818-fc66-4a13-9f3c-503bb8f7598e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Returning 404 to user: Instance b2380477-dae7-428a-a5ba-ee0b14d8e91e could not be found. {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:26:34.442898 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-daf0f818-fc66-4a13-9f3c-503bb8f7598e tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e" status: 404 len: 111 microversion: 2.1 time: 0.030454 Aug 09 18:26:34.442898 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 475/971] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:34 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:26:34.447173 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5181a8df-fef9-4978-b77b-b318be6346bf tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '.version_select at 0x7f4c354a5670>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:34.548082 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-5181a8df-fef9-4978-b77b-b318be6346bf tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-88294841" status: 202 len: 0 microversion: 2.1 time: 0.104605 Aug 09 18:26:34.548673 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 497/972] 10.222.0.36 () {58 vars in 1215 bytes} [Tue Aug 9 18:26:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-88294841 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:26:37.902647 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-65a90808-6f0e-4404-8307-b420095862c9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:37.903210 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-65a90808-6f0e-4404-8307-b420095862c9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:37.910264 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-65a90808-6f0e-4404-8307-b420095862c9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:37.910777 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-65a90808-6f0e-4404-8307-b420095862c9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:37.911219 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-65a90808-6f0e-4404-8307-b420095862c9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:37.911905 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-65a90808-6f0e-4404-8307-b420095862c9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:37.912358 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-65a90808-6f0e-4404-8307-b420095862c9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:37.912780 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-65a90808-6f0e-4404-8307-b420095862c9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:37.926980 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-65a90808-6f0e-4404-8307-b420095862c9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] HTTP exception thrown: Instance b2380477-dae7-428a-a5ba-ee0b14d8e91e could not be found. Aug 09 18:26:37.928483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-65a90808-6f0e-4404-8307-b420095862c9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Request method failure captured: Aug 09 18:26:37.928483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: DELETE /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e HTTP/1.1 Aug 09 18:26:37.928483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:26:37.928483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:26:37.928483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:26:37.928483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 0 Aug 09 18:26:37.928483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:26:37.928483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:26:37.928483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:26:37.928483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:26:37.928483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qTBVqPk4pl3xjTXh-vq2d9g5Jblc0yO57MGdyZvr84ccuFN_X7CCb-PNCv6uJ_iAzgwKSL7HL9VzncoyOfgA5jaPc66FIOAMazSQ5UgccsSgTmgCY6KqelNNNA8rRkhbZigJN9qQGtEE7r-OFahXTOcT7uQMnCZlOVhfWLSifhlhoU Aug 09 18:26:37.928483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:26:37.928483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:26:37.928483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:26:37.928483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:26:37.928483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:26:37.928483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:26:37.928483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: b23fb97c7c4049c49f6bad8418fc4dec Aug 09 18:26:37.928483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-AttachVolumeTestJSON-1043964365 Aug 09 18:26:37.928483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:26:37.928483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:26:37.930120 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b23fb97c7c4049c49f6bad8418fc4dec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b23fb97c7c4049c49f6bad8418fc4dec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b23fb97c7c4049c49f6bad8418fc4dec", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b23fb97c7c4049c49f6bad8418fc4dec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:26:37.930120 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-AttachVolumeTestJSON-1043964365 Aug 09 18:26:37.930120 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: b23fb97c7c4049c49f6bad8418fc4dec Aug 09 18:26:37.930120 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1043964365 Aug 09 18:26:37.930120 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-AttachVolumeTestJSON-1043964365-project Aug 09 18:26:37.930120 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:26:37.930120 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:26:37.930120 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: a6c7401eaf744ef895bacc294f7c6268 Aug 09 18:26:37.930120 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-AttachVolumeTestJSON-1043964365-project Aug 09 18:26:37.930120 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: > Aug 09 18:26:37.930120 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Instance b2380477-dae7-428a-a5ba-ee0b14d8e91e could not be found. Aug 09 18:26:37.930120 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'id': 'b2380477-dae7-428a-a5ba-ee0b14d8e91e'} Aug 09 18:26:37.931318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:26:37.931318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:37.931318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:26:37.931318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:26:37.931318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:26:37.931318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:26:37.931318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:26:37.931318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:26:37.931318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:26:37.931318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:26:37.931318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2380477-dae7-428a-a5ba-ee0b14d8e91e could not be found. Aug 09 18:26:37.931318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:37.931318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:26:37.931318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:37.931318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:37.931318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:26:37.931318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:26:37.931318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:26:37.931318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:26:37.931318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:26:37.932790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:26:37.932790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:26:37.932790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:26:37.932790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:26:37.932790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:26:37.932790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:26:37.932790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:26:37.932790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:26:37.932790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:26:37.932790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2380477-dae7-428a-a5ba-ee0b14d8e91e could not be found. Aug 09 18:26:37.932790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:37.932790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:26:37.932790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:37.932790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:37.932790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:26:37.932790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:26:37.932790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:26:37.932790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:26:37.932790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2380477-dae7-428a-a5ba-ee0b14d8e91e could not be found. Aug 09 18:26:37.932790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:37.934325 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-65a90808-6f0e-4404-8307-b420095862c9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Returning 404 to user: Instance b2380477-dae7-428a-a5ba-ee0b14d8e91e could not be found. {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:26:37.934325 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-65a90808-6f0e-4404-8307-b420095862c9 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e" status: 404 len: 111 microversion: 2.1 time: 0.031022 Aug 09 18:26:37.934325 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 476/973] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:26:37 2022] DELETE /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:26:37.939003 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f2cd8a2c-fe50-4247-acc3-a3b433901d78 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:37.939616 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f2cd8a2c-fe50-4247-acc3-a3b433901d78 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: b2380477-dae7-428a-a5ba-ee0b14d8e91e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:37.946029 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f2cd8a2c-fe50-4247-acc3-a3b433901d78 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:37.946505 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f2cd8a2c-fe50-4247-acc3-a3b433901d78 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:37.946968 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f2cd8a2c-fe50-4247-acc3-a3b433901d78 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:37.947646 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f2cd8a2c-fe50-4247-acc3-a3b433901d78 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:37.948097 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f2cd8a2c-fe50-4247-acc3-a3b433901d78 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:37.948515 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f2cd8a2c-fe50-4247-acc3-a3b433901d78 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:37.961404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-f2cd8a2c-fe50-4247-acc3-a3b433901d78 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] HTTP exception thrown: Instance b2380477-dae7-428a-a5ba-ee0b14d8e91e could not be found. Aug 09 18:26:37.963055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f2cd8a2c-fe50-4247-acc3-a3b433901d78 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Request method failure captured: Aug 09 18:26:37.963055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e HTTP/1.1 Aug 09 18:26:37.963055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:26:37.963055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:26:37.963055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:26:37.963055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:26:37.963055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:26:37.963055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:26:37.963055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:26:37.963055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:26:37.963055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qTBVqPk4pl3xjTXh-vq2d9g5Jblc0yO57MGdyZvr84ccuFN_X7CCb-PNCv6uJ_iAzgwKSL7HL9VzncoyOfgA5jaPc66FIOAMazSQ5UgccsSgTmgCY6KqelNNNA8rRkhbZigJN9qQGtEE7r-OFahXTOcT7uQMnCZlOVhfWLSifhlhoU Aug 09 18:26:37.963055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:26:37.963055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:26:37.963055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:26:37.963055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:26:37.963055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:26:37.963055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:26:37.963055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: b23fb97c7c4049c49f6bad8418fc4dec Aug 09 18:26:37.963055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-AttachVolumeTestJSON-1043964365 Aug 09 18:26:37.963055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:26:37.963055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:26:37.964681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b23fb97c7c4049c49f6bad8418fc4dec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b23fb97c7c4049c49f6bad8418fc4dec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b23fb97c7c4049c49f6bad8418fc4dec", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b23fb97c7c4049c49f6bad8418fc4dec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:26:37.964681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-AttachVolumeTestJSON-1043964365 Aug 09 18:26:37.964681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: b23fb97c7c4049c49f6bad8418fc4dec Aug 09 18:26:37.964681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1043964365 Aug 09 18:26:37.964681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-AttachVolumeTestJSON-1043964365-project Aug 09 18:26:37.964681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:26:37.964681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:26:37.964681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: a6c7401eaf744ef895bacc294f7c6268 Aug 09 18:26:37.964681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-AttachVolumeTestJSON-1043964365-project Aug 09 18:26:37.964681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:26:37.964681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Instance b2380477-dae7-428a-a5ba-ee0b14d8e91e could not be found. Aug 09 18:26:37.964681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': 'b2380477-dae7-428a-a5ba-ee0b14d8e91e'} Aug 09 18:26:37.965815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:26:37.965815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:37.965815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:26:37.965815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:26:37.965815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:26:37.965815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:26:37.965815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:26:37.965815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:26:37.965815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:26:37.965815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:26:37.965815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2380477-dae7-428a-a5ba-ee0b14d8e91e could not be found. Aug 09 18:26:37.965815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:26:37.965815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:26:37.965815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:26:37.965815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:37.965815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:26:37.965815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:26:37.965815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:26:37.965815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:26:37.965815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:26:37.967432 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:26:37.967432 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:26:37.967432 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:26:37.967432 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:26:37.967432 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:26:37.967432 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:26:37.967432 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:26:37.967432 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2380477-dae7-428a-a5ba-ee0b14d8e91e could not be found. Aug 09 18:26:37.967432 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:26:37.967432 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:26:37.967432 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:26:37.967432 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:37.967432 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:26:37.967432 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:26:37.967432 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:26:37.967432 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:26:37.967432 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2380477-dae7-428a-a5ba-ee0b14d8e91e could not be found. Aug 09 18:26:37.967432 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:26:37.968805 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f2cd8a2c-fe50-4247-acc3-a3b433901d78 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Returning 404 to user: Instance b2380477-dae7-428a-a5ba-ee0b14d8e91e could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:26:37.968805 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f2cd8a2c-fe50-4247-acc3-a3b433901d78 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e" status: 404 len: 111 microversion: 2.1 time: 0.030091 Aug 09 18:26:37.968805 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 498/974] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:37 2022] GET /compute/v2.1/servers/b2380477-dae7-428a-a5ba-ee0b14d8e91e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:26:39.245185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-466917e6-93b7-4d49-b93d-72aa74716a3d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:39.245713 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-466917e6-93b7-4d49-b93d-72aa74716a3d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:39.252730 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-466917e6-93b7-4d49-b93d-72aa74716a3d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:39.253214 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-466917e6-93b7-4d49-b93d-72aa74716a3d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:39.253652 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-466917e6-93b7-4d49-b93d-72aa74716a3d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:39.254348 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-466917e6-93b7-4d49-b93d-72aa74716a3d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:39.254831 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-466917e6-93b7-4d49-b93d-72aa74716a3d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:39.255258 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-466917e6-93b7-4d49-b93d-72aa74716a3d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:39.269091 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-466917e6-93b7-4d49-b93d-72aa74716a3d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] HTTP exception thrown: Instance e9924434-5f51-4c4e-8355-93e69db65d9e could not be found. Aug 09 18:26:39.270655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-466917e6-93b7-4d49-b93d-72aa74716a3d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Request method failure captured: Aug 09 18:26:39.270655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: DELETE /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e HTTP/1.1 Aug 09 18:26:39.270655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:26:39.270655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:26:39.270655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:26:39.270655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 0 Aug 09 18:26:39.270655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:26:39.270655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:26:39.270655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:26:39.270655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:26:39.270655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qTBVqPk4pl3xjTXh-vq2d9g5Jblc0yO57MGdyZvr84ccuFN_X7CCb-PNCv6uJ_iAzgwKSL7HL9VzncoyOfgA5jaPc66FIOAMazSQ5UgccsSgTmgCY6KqelNNNA8rRkhbZigJN9qQGtEE7r-OFahXTOcT7uQMnCZlOVhfWLSifhlhoU Aug 09 18:26:39.270655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:26:39.270655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:26:39.270655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:26:39.270655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:26:39.270655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:26:39.270655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:26:39.270655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: b23fb97c7c4049c49f6bad8418fc4dec Aug 09 18:26:39.270655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-AttachVolumeTestJSON-1043964365 Aug 09 18:26:39.270655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:26:39.270655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:26:39.272361 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b23fb97c7c4049c49f6bad8418fc4dec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b23fb97c7c4049c49f6bad8418fc4dec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b23fb97c7c4049c49f6bad8418fc4dec", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b23fb97c7c4049c49f6bad8418fc4dec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:26:39.272361 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-AttachVolumeTestJSON-1043964365 Aug 09 18:26:39.272361 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: b23fb97c7c4049c49f6bad8418fc4dec Aug 09 18:26:39.272361 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1043964365 Aug 09 18:26:39.272361 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-AttachVolumeTestJSON-1043964365-project Aug 09 18:26:39.272361 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:26:39.272361 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:26:39.272361 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: a6c7401eaf744ef895bacc294f7c6268 Aug 09 18:26:39.272361 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-AttachVolumeTestJSON-1043964365-project Aug 09 18:26:39.272361 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: > Aug 09 18:26:39.272361 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Instance e9924434-5f51-4c4e-8355-93e69db65d9e could not be found. Aug 09 18:26:39.272361 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'id': 'e9924434-5f51-4c4e-8355-93e69db65d9e'} Aug 09 18:26:39.273129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:26:39.273129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:39.273129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:26:39.273129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:26:39.273129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:26:39.273129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:26:39.273129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:26:39.273129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:26:39.273129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:26:39.273129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:26:39.273129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9924434-5f51-4c4e-8355-93e69db65d9e could not be found. Aug 09 18:26:39.273129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:39.273129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:26:39.273129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:39.273129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:39.273129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:26:39.273129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:26:39.273129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:26:39.273129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:26:39.273129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:26:39.274397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:26:39.274397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:26:39.274397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:26:39.274397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:26:39.274397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:26:39.274397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:26:39.274397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:26:39.274397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:26:39.274397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:26:39.274397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9924434-5f51-4c4e-8355-93e69db65d9e could not be found. Aug 09 18:26:39.274397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:39.274397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:26:39.274397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:39.274397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:39.274397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:26:39.274397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:26:39.274397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:26:39.274397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:26:39.274397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9924434-5f51-4c4e-8355-93e69db65d9e could not be found. Aug 09 18:26:39.274397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:39.276809 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-466917e6-93b7-4d49-b93d-72aa74716a3d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Returning 404 to user: Instance e9924434-5f51-4c4e-8355-93e69db65d9e could not be found. {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:26:39.276809 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-466917e6-93b7-4d49-b93d-72aa74716a3d tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 404 len: 111 microversion: 2.1 time: 0.030688 Aug 09 18:26:39.276809 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 477/975] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:26:39 2022] DELETE /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:26:39.280494 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6e7af81e-2564-4501-b53d-f8c95dc111f2 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:39.281112 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-6e7af81e-2564-4501-b53d-f8c95dc111f2 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] [instance: e9924434-5f51-4c4e-8355-93e69db65d9e] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:39.287265 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e7af81e-2564-4501-b53d-f8c95dc111f2 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:39.287749 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e7af81e-2564-4501-b53d-f8c95dc111f2 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:39.288185 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e7af81e-2564-4501-b53d-f8c95dc111f2 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:39.288879 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e7af81e-2564-4501-b53d-f8c95dc111f2 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:39.289335 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e7af81e-2564-4501-b53d-f8c95dc111f2 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:39.289765 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6e7af81e-2564-4501-b53d-f8c95dc111f2 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:39.303363 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-6e7af81e-2564-4501-b53d-f8c95dc111f2 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] HTTP exception thrown: Instance e9924434-5f51-4c4e-8355-93e69db65d9e could not be found. Aug 09 18:26:39.304842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6e7af81e-2564-4501-b53d-f8c95dc111f2 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Request method failure captured: Aug 09 18:26:39.304842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e HTTP/1.1 Aug 09 18:26:39.304842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:26:39.304842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:26:39.304842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:26:39.304842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:26:39.304842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:26:39.304842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:26:39.304842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:26:39.304842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:26:39.304842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qTBVqPk4pl3xjTXh-vq2d9g5Jblc0yO57MGdyZvr84ccuFN_X7CCb-PNCv6uJ_iAzgwKSL7HL9VzncoyOfgA5jaPc66FIOAMazSQ5UgccsSgTmgCY6KqelNNNA8rRkhbZigJN9qQGtEE7r-OFahXTOcT7uQMnCZlOVhfWLSifhlhoU Aug 09 18:26:39.304842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:26:39.304842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:26:39.304842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:26:39.304842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:26:39.304842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:26:39.304842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:26:39.304842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: b23fb97c7c4049c49f6bad8418fc4dec Aug 09 18:26:39.304842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-AttachVolumeTestJSON-1043964365 Aug 09 18:26:39.304842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:26:39.304842 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:26:39.306481 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b23fb97c7c4049c49f6bad8418fc4dec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b23fb97c7c4049c49f6bad8418fc4dec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b23fb97c7c4049c49f6bad8418fc4dec", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b23fb97c7c4049c49f6bad8418fc4dec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:26:39.306481 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-AttachVolumeTestJSON-1043964365 Aug 09 18:26:39.306481 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: b23fb97c7c4049c49f6bad8418fc4dec Aug 09 18:26:39.306481 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1043964365 Aug 09 18:26:39.306481 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-AttachVolumeTestJSON-1043964365-project Aug 09 18:26:39.306481 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:26:39.306481 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:26:39.306481 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: a6c7401eaf744ef895bacc294f7c6268 Aug 09 18:26:39.306481 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-AttachVolumeTestJSON-1043964365-project Aug 09 18:26:39.306481 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:26:39.306481 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Instance e9924434-5f51-4c4e-8355-93e69db65d9e could not be found. Aug 09 18:26:39.306481 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': 'e9924434-5f51-4c4e-8355-93e69db65d9e'} Aug 09 18:26:39.307550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:26:39.307550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:39.307550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:26:39.307550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:26:39.307550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:26:39.307550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:26:39.307550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:26:39.307550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:26:39.307550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:26:39.307550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:26:39.307550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9924434-5f51-4c4e-8355-93e69db65d9e could not be found. Aug 09 18:26:39.307550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:26:39.307550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:26:39.307550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:26:39.307550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:39.307550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:26:39.307550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:26:39.307550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:26:39.307550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:26:39.307550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:26:39.309124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:26:39.309124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:26:39.309124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:26:39.309124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:26:39.309124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:26:39.309124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:26:39.309124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:26:39.309124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9924434-5f51-4c4e-8355-93e69db65d9e could not be found. Aug 09 18:26:39.309124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:26:39.309124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:26:39.309124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:26:39.309124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:39.309124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:26:39.309124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:26:39.309124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:26:39.309124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:26:39.309124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9924434-5f51-4c4e-8355-93e69db65d9e could not be found. Aug 09 18:26:39.309124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:26:39.310552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6e7af81e-2564-4501-b53d-f8c95dc111f2 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] Returning 404 to user: Instance e9924434-5f51-4c4e-8355-93e69db65d9e could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:26:39.310552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-6e7af81e-2564-4501-b53d-f8c95dc111f2 tempest-AttachVolumeTestJSON-1043964365 tempest-AttachVolumeTestJSON-1043964365-project] 10.222.0.36 "GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e" status: 404 len: 111 microversion: 2.1 time: 0.029508 Aug 09 18:26:39.310552 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 499/976] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:39 2022] GET /compute/v2.1/servers/e9924434-5f51-4c4e-8355-93e69db65d9e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:26:50.300301 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:26:50.301439 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:26:50.408553 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d788c3c0-40b4-45bc-bf79-06aebb6e79c3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Action: 'create', calling method: .version_select at 0x7f4c35244430>, body: {"keypair": {"name": "tempest-keypair-496154608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuCJTW3YXzWGjQvVgR+4DK9zuSK2kGQvJVVxNsamK7z4HmJtDnx6hM5O3zxEbGMohI0ekGlLwbRiun7v8WlE0tpSmUgfFtGXmNPGXVaaH/3DKDBwWA7brMpgvHT1yWDSQ=="}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:26:50.423934 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-d788c3c0-40b4-45bc-bf79-06aebb6e79c3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Getting quotas for project ef103f8a63404f918eaa5dd0c626b4c0. Resources: {'key_pairs'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:26:50.427907 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-d788c3c0-40b4-45bc-bf79-06aebb6e79c3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Getting quotas for user b5ffbaec36054aa3a89cca8b6007c8bb and project ef103f8a63404f918eaa5dd0c626b4c0. Resources: {'key_pairs'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:26:50.484977 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d788c3c0-40b4-45bc-bf79-06aebb6e79c3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.189814 Aug 09 18:26:50.485749 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 478/977] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Aug 9 18:26:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:26:52.927153 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2411e8ec-d74d-4a3c-9e56-3adf5c1096e6 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-501352117", "imageRef": "53732c26-c942-4646-ac3f-8d9e11ab4d57", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b718d6b0-7ac1-48df-9d78-732c5ed8dfb4"}], "security_groups": [{"name": "tempest-securitygroup--27164101"}], "key_name": "tempest-keypair-496154608", "user_data": "}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:26:52.936722 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:26:52.937463 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:26:53.040351 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.network.neutron [None req-2411e8ec-d74d-4a3c-9e56-3adf5c1096e6 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] validate_networks() for [('b718d6b0-7ac1-48df-9d78-732c5ed8dfb4', None, None, None, None, None)] {{(pid=118313) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:26:53.488515 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-2411e8ec-d74d-4a3c-9e56-3adf5c1096e6 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Flavor limits 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:26:53.488944 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-2411e8ec-d74d-4a3c-9e56-3adf5c1096e6 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Image limits 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:26:53.489418 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-2411e8ec-d74d-4a3c-9e56-3adf5c1096e6 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Flavor pref 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:26:53.489829 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-2411e8ec-d74d-4a3c-9e56-3adf5c1096e6 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Image pref 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:26:53.490245 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-2411e8ec-d74d-4a3c-9e56-3adf5c1096e6 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:26:53.499157 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2411e8ec-d74d-4a3c-9e56-3adf5c1096e6 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:53.499649 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2411e8ec-d74d-4a3c-9e56-3adf5c1096e6 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:53.500087 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2411e8ec-d74d-4a3c-9e56-3adf5c1096e6 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:53.501309 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2411e8ec-d74d-4a3c-9e56-3adf5c1096e6 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:53.501763 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2411e8ec-d74d-4a3c-9e56-3adf5c1096e6 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:53.502188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2411e8ec-d74d-4a3c-9e56-3adf5c1096e6 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:53.519599 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-2411e8ec-d74d-4a3c-9e56-3adf5c1096e6 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Getting quotas for project ef103f8a63404f918eaa5dd0c626b4c0. Resources: {'cores', 'instances', 'ram'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:26:53.523509 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-2411e8ec-d74d-4a3c-9e56-3adf5c1096e6 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Getting quotas for user b5ffbaec36054aa3a89cca8b6007c8bb and project ef103f8a63404f918eaa5dd0c626b4c0. Resources: {'cores', 'instances', 'ram'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:26:53.534614 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-2411e8ec-d74d-4a3c-9e56-3adf5c1096e6 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Going to run 1 instances... {{(pid=118313) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:26:53.536927 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-2411e8ec-d74d-4a3c-9e56-3adf5c1096e6 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53732c26-c942-4646-ac3f-8d9e11ab4d57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118313) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:26:53.674860 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-2411e8ec-d74d-4a3c-9e56-3adf5c1096e6 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.752682 Aug 09 18:26:53.675605 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 500/978] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Aug 9 18:26:52 2022] POST /compute/v2.1/servers => generated 400 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:26:53.687203 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-80461473-c690-4890-bdb2-2a099c36cef3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:53.687904 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-80461473-c690-4890-bdb2-2a099c36cef3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:53.753749 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-80461473-c690-4890-bdb2-2a099c36cef3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:53.760915 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-80461473-c690-4890-bdb2-2a099c36cef3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312" status: 200 len: 1240 microversion: 2.1 time: 0.078123 Aug 09 18:26:53.772890 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 479/979] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:53 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:26:54.571560 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-8d950209-5f29-417e-aa36-b76ff13a195e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:54.573833 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-8d950209-5f29-417e-aa36-b76ff13a195e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:54.581596 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8d950209-5f29-417e-aa36-b76ff13a195e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:54.582080 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8d950209-5f29-417e-aa36-b76ff13a195e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:54.582532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8d950209-5f29-417e-aa36-b76ff13a195e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:54.583233 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8d950209-5f29-417e-aa36-b76ff13a195e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:54.583684 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8d950209-5f29-417e-aa36-b76ff13a195e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:54.584152 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-8d950209-5f29-417e-aa36-b76ff13a195e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:54.614901 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-8d950209-5f29-417e-aa36-b76ff13a195e tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047179 Aug 09 18:26:54.615455 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 501/980] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Aug 9 18:26:54 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:26:54.678118 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-141779ed-f053-4f7e-84f0-0e4889617768 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:54.678622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-141779ed-f053-4f7e-84f0-0e4889617768 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:54.684497 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-141779ed-f053-4f7e-84f0-0e4889617768 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:54.684983 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-141779ed-f053-4f7e-84f0-0e4889617768 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:54.685535 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-141779ed-f053-4f7e-84f0-0e4889617768 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:54.686228 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-141779ed-f053-4f7e-84f0-0e4889617768 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:54.686682 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-141779ed-f053-4f7e-84f0-0e4889617768 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:54.687134 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-141779ed-f053-4f7e-84f0-0e4889617768 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:54.714501 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-141779ed-f053-4f7e-84f0-0e4889617768 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Going to try to terminate instance {{(pid=118314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:26:54.783195 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-7aeb0a39-65bb-44cf-9f64-ab84ea869aff tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:54.783841 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-7aeb0a39-65bb-44cf-9f64-ab84ea869aff tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:54.789830 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7aeb0a39-65bb-44cf-9f64-ab84ea869aff tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:54.790261 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7aeb0a39-65bb-44cf-9f64-ab84ea869aff tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:54.790698 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7aeb0a39-65bb-44cf-9f64-ab84ea869aff tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:54.791438 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7aeb0a39-65bb-44cf-9f64-ab84ea869aff tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:54.791898 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7aeb0a39-65bb-44cf-9f64-ab84ea869aff tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:54.792325 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-7aeb0a39-65bb-44cf-9f64-ab84ea869aff tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:54.856308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-7aeb0a39-65bb-44cf-9f64-ab84ea869aff tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:54.864665 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-7aeb0a39-65bb-44cf-9f64-ab84ea869aff tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312" status: 200 len: 1244 microversion: 2.1 time: 0.085951 Aug 09 18:26:54.875274 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 502/981] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:54 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:26:55.008230 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-141779ed-f053-4f7e-84f0-0e4889617768 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "DELETE /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 204 len: 0 microversion: 2.20 time: 0.333625 Aug 09 18:26:55.008858 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 480/982] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Aug 9 18:26:54 2022] DELETE /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 18:26:55.017394 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-46841995-ec9d-4c94-8762-a30037dde1ce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:55.018037 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-46841995-ec9d-4c94-8762-a30037dde1ce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:55.024323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-46841995-ec9d-4c94-8762-a30037dde1ce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:55.024818 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-46841995-ec9d-4c94-8762-a30037dde1ce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:55.025263 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-46841995-ec9d-4c94-8762-a30037dde1ce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:55.025959 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-46841995-ec9d-4c94-8762-a30037dde1ce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:55.026433 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-46841995-ec9d-4c94-8762-a30037dde1ce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:55.026877 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-46841995-ec9d-4c94-8762-a30037dde1ce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:55.157928 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-46841995-ec9d-4c94-8762-a30037dde1ce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:55.166248 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-46841995-ec9d-4c94-8762-a30037dde1ce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:55.167988 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-46841995-ec9d-4c94-8762-a30037dde1ce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:55.169165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-46841995-ec9d-4c94-8762-a30037dde1ce tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1723 microversion: 2.20 time: 0.156079 Aug 09 18:26:55.169729 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 503/983] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:26:55 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:26:55.887346 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-4fb3264c-5ad9-496b-9033-8d38b0f992a3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:55.888241 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-4fb3264c-5ad9-496b-9033-8d38b0f992a3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:55.895217 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4fb3264c-5ad9-496b-9033-8d38b0f992a3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:55.895631 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4fb3264c-5ad9-496b-9033-8d38b0f992a3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:55.896066 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4fb3264c-5ad9-496b-9033-8d38b0f992a3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:55.896757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4fb3264c-5ad9-496b-9033-8d38b0f992a3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:55.897204 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4fb3264c-5ad9-496b-9033-8d38b0f992a3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:55.897623 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4fb3264c-5ad9-496b-9033-8d38b0f992a3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:55.962190 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-4fb3264c-5ad9-496b-9033-8d38b0f992a3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:55.971961 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-4fb3264c-5ad9-496b-9033-8d38b0f992a3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312" status: 200 len: 1236 microversion: 2.1 time: 0.089082 Aug 09 18:26:55.972530 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 481/984] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:55 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 => generated 1236 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:26:56.192302 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6822d38d-6941-4595-8a69-d1f7bb9db52c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:56.192928 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-6822d38d-6941-4595-8a69-d1f7bb9db52c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:56.199364 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6822d38d-6941-4595-8a69-d1f7bb9db52c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:56.199843 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6822d38d-6941-4595-8a69-d1f7bb9db52c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:56.200273 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6822d38d-6941-4595-8a69-d1f7bb9db52c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:56.201177 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6822d38d-6941-4595-8a69-d1f7bb9db52c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:56.201631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6822d38d-6941-4595-8a69-d1f7bb9db52c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:56.202057 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6822d38d-6941-4595-8a69-d1f7bb9db52c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:56.340933 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6822d38d-6941-4595-8a69-d1f7bb9db52c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:56.350115 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6822d38d-6941-4595-8a69-d1f7bb9db52c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:56.351663 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6822d38d-6941-4595-8a69-d1f7bb9db52c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:56.352823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-6822d38d-6941-4595-8a69-d1f7bb9db52c tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1723 microversion: 2.20 time: 0.164806 Aug 09 18:26:56.353389 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 504/985] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:26:56 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:26:56.993956 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8f10f145-aaf6-4580-802a-5cd3e38d0e6a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:56.994577 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8f10f145-aaf6-4580-802a-5cd3e38d0e6a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:57.003040 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8f10f145-aaf6-4580-802a-5cd3e38d0e6a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:57.003552 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8f10f145-aaf6-4580-802a-5cd3e38d0e6a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:57.003984 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8f10f145-aaf6-4580-802a-5cd3e38d0e6a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:57.004677 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8f10f145-aaf6-4580-802a-5cd3e38d0e6a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:57.005129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8f10f145-aaf6-4580-802a-5cd3e38d0e6a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:57.005548 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8f10f145-aaf6-4580-802a-5cd3e38d0e6a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:57.097875 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8f10f145-aaf6-4580-802a-5cd3e38d0e6a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:57.107266 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8f10f145-aaf6-4580-802a-5cd3e38d0e6a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312" status: 200 len: 1300 microversion: 2.1 time: 0.115165 Aug 09 18:26:57.107266 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 482/986] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:56 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 => generated 1300 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:26:57.377614 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-3a75fb93-316f-41d4-bf92-957799418a6d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:57.378246 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-3a75fb93-316f-41d4-bf92-957799418a6d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:57.384830 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3a75fb93-316f-41d4-bf92-957799418a6d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:57.385308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3a75fb93-316f-41d4-bf92-957799418a6d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:57.391970 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3a75fb93-316f-41d4-bf92-957799418a6d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:57.391970 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3a75fb93-316f-41d4-bf92-957799418a6d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:57.391970 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3a75fb93-316f-41d4-bf92-957799418a6d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:57.391970 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3a75fb93-316f-41d4-bf92-957799418a6d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:57.643990 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-3a75fb93-316f-41d4-bf92-957799418a6d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:57.652408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-3a75fb93-316f-41d4-bf92-957799418a6d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:57.654051 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-3a75fb93-316f-41d4-bf92-957799418a6d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:57.655249 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-3a75fb93-316f-41d4-bf92-957799418a6d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1723 microversion: 2.20 time: 0.282254 Aug 09 18:26:57.660000 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 505/987] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:26:57 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:26:58.128398 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-5ace9966-39bc-42c6-8eb0-1a6bb8dca632 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:58.129822 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-5ace9966-39bc-42c6-8eb0-1a6bb8dca632 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:58.136919 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5ace9966-39bc-42c6-8eb0-1a6bb8dca632 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:58.137788 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5ace9966-39bc-42c6-8eb0-1a6bb8dca632 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:58.138225 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5ace9966-39bc-42c6-8eb0-1a6bb8dca632 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:58.139182 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5ace9966-39bc-42c6-8eb0-1a6bb8dca632 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:58.139811 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5ace9966-39bc-42c6-8eb0-1a6bb8dca632 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:58.140244 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5ace9966-39bc-42c6-8eb0-1a6bb8dca632 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:58.249995 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-5ace9966-39bc-42c6-8eb0-1a6bb8dca632 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:58.271331 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-5ace9966-39bc-42c6-8eb0-1a6bb8dca632 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312" status: 200 len: 1298 microversion: 2.1 time: 0.135491 Aug 09 18:26:58.271331 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 483/988] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:58 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 => generated 1298 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:26:58.278662 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-f7023a82-cd67-4a91-a479-a63f9c554e35 req-6e87ad8d-966a-4d9b-b825-92ef15c10c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262e54dc-8819-4689-ad3a-577f966f5a21", "name": "network-vif-deleted", "tag": "0326ddaa-6e24-40bf-9ac7-991d3e2669c4"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:26:58.290616 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-f7023a82-cd67-4a91-a479-a63f9c554e35 req-6e87ad8d-966a-4d9b-b825-92ef15c10c5f service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:58.291137 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-f7023a82-cd67-4a91-a479-a63f9c554e35 req-6e87ad8d-966a-4d9b-b825-92ef15c10c5f service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:58.291628 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-f7023a82-cd67-4a91-a479-a63f9c554e35 req-6e87ad8d-966a-4d9b-b825-92ef15c10c5f service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:58.303076 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-f7023a82-cd67-4a91-a479-a63f9c554e35 req-6e87ad8d-966a-4d9b-b825-92ef15c10c5f service nova] Creating event network-vif-deleted:0326ddaa-6e24-40bf-9ac7-991d3e2669c4 for instance 262e54dc-8819-4689-ad3a-577f966f5a21 on hv-cinder-79797 Aug 09 18:26:58.308312 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-f7023a82-cd67-4a91-a479-a63f9c554e35 req-6e87ad8d-966a-4d9b-b825-92ef15c10c5f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035608 Aug 09 18:26:58.309296 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 506/989] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:26:58.679665 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8f27ebfe-eb5f-4a7e-bcd4-669cc4499858 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:58.680203 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8f27ebfe-eb5f-4a7e-bcd4-669cc4499858 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:58.686295 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8f27ebfe-eb5f-4a7e-bcd4-669cc4499858 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:58.686907 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8f27ebfe-eb5f-4a7e-bcd4-669cc4499858 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:58.687403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8f27ebfe-eb5f-4a7e-bcd4-669cc4499858 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:58.688835 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8f27ebfe-eb5f-4a7e-bcd4-669cc4499858 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:58.689398 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8f27ebfe-eb5f-4a7e-bcd4-669cc4499858 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:58.690146 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8f27ebfe-eb5f-4a7e-bcd4-669cc4499858 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:58.726311 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8f27ebfe-eb5f-4a7e-bcd4-669cc4499858 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:58.727127 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8f27ebfe-eb5f-4a7e-bcd4-669cc4499858 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:58.727723 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8f27ebfe-eb5f-4a7e-bcd4-669cc4499858 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:58.735954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.objects.instance [None req-8f27ebfe-eb5f-4a7e-bcd4-669cc4499858 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lazy-loading 'fault' on Instance uuid 262e54dc-8819-4689-ad3a-577f966f5a21 {{(pid=118314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:26:58.785160 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8f27ebfe-eb5f-4a7e-bcd4-669cc4499858 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:58.794357 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8f27ebfe-eb5f-4a7e-bcd4-669cc4499858 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:58.799337 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8f27ebfe-eb5f-4a7e-bcd4-669cc4499858 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '528811040ede40bdb40e3e6e666d283d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2e5c4bafff4b16bb9d82dacb5dd056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:58.799337 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8f27ebfe-eb5f-4a7e-bcd4-669cc4499858 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 200 len: 1371 microversion: 2.20 time: 0.121569 Aug 09 18:26:58.799337 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 484/990] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:26:58 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 1371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 18:26:59.283748 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9438eb25-7510-47f8-b3ca-70ff52dd14a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:59.284551 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9438eb25-7510-47f8-b3ca-70ff52dd14a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:59.292653 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9438eb25-7510-47f8-b3ca-70ff52dd14a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:59.293163 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9438eb25-7510-47f8-b3ca-70ff52dd14a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:59.293603 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9438eb25-7510-47f8-b3ca-70ff52dd14a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:59.294370 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9438eb25-7510-47f8-b3ca-70ff52dd14a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:59.294859 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9438eb25-7510-47f8-b3ca-70ff52dd14a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:59.295331 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9438eb25-7510-47f8-b3ca-70ff52dd14a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:59.818344 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9438eb25-7510-47f8-b3ca-70ff52dd14a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:59.821552 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f82136a5-24f6-4a31-9be6-1e85a44b0f26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:59.822844 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f82136a5-24f6-4a31-9be6-1e85a44b0f26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:59.826530 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9438eb25-7510-47f8-b3ca-70ff52dd14a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312" status: 200 len: 1364 microversion: 2.1 time: 0.547719 Aug 09 18:26:59.827233 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 507/991] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:59 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 => generated 1364 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:26:59.829648 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f82136a5-24f6-4a31-9be6-1e85a44b0f26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:59.830247 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f82136a5-24f6-4a31-9be6-1e85a44b0f26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:59.830687 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f82136a5-24f6-4a31-9be6-1e85a44b0f26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:59.831417 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f82136a5-24f6-4a31-9be6-1e85a44b0f26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:59.831923 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f82136a5-24f6-4a31-9be6-1e85a44b0f26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:59.832353 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f82136a5-24f6-4a31-9be6-1e85a44b0f26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:59.846674 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-f82136a5-24f6-4a31-9be6-1e85a44b0f26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] HTTP exception thrown: Instance 262e54dc-8819-4689-ad3a-577f966f5a21 could not be found. Aug 09 18:26:59.848633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f82136a5-24f6-4a31-9be6-1e85a44b0f26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Request method failure captured: Aug 09 18:26:59.848633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 HTTP/1.1 Aug 09 18:26:59.848633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:26:59.848633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:26:59.848633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:26:59.848633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 0 Aug 09 18:26:59.848633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:26:59.848633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:26:59.848633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:26:59.848633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:26:59.848633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qRH6oZvLYQzHHN5HiJQoKEuKN1gFCTx2nB6hBKLAZJDo6gRYlnHyk5KBDlF_RxYLpSZ8RIGNpVqT6M5QMjE12ok36SKMDQPp8Ay9fDGma13RsX7D6onn9MKNQ_v3NCaONsTOjUgfR_mpEXkOb0e1XxZoskKzZdOnHgLXtUDhf6O6JQ Aug 09 18:26:59.848633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:26:59.848633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:26:59.848633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:26:59.848633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:26:59.848633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 18:26:59.848633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:26:59.848633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:26:59.848633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: ac2e5c4bafff4b16bb9d82dacb5dd056 Aug 09 18:26:59.848633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-344752246 Aug 09 18:26:59.848633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:26:59.848633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:26:59.850336 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ac2e5c4bafff4b16bb9d82dacb5dd056"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ac2e5c4bafff4b16bb9d82dacb5dd056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ac2e5c4bafff4b16bb9d82dacb5dd056", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ac2e5c4bafff4b16bb9d82dacb5dd056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:26:59.850336 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-AttachVolumeShelveTestJSON-344752246 Aug 09 18:26:59.850336 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: ac2e5c4bafff4b16bb9d82dacb5dd056 Aug 09 18:26:59.850336 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-344752246 Aug 09 18:26:59.850336 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-AttachVolumeShelveTestJSON-344752246-project Aug 09 18:26:59.850336 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:26:59.850336 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:26:59.850336 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: 528811040ede40bdb40e3e6e666d283d Aug 09 18:26:59.850336 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-AttachVolumeShelveTestJSON-344752246-project Aug 09 18:26:59.850336 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: > Aug 09 18:26:59.850336 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Instance 262e54dc-8819-4689-ad3a-577f966f5a21 could not be found. Aug 09 18:26:59.850336 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'id': '262e54dc-8819-4689-ad3a-577f966f5a21'} Aug 09 18:26:59.851282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:26:59.851282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:59.851282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:26:59.851282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:26:59.851282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:26:59.851282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:26:59.851282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:26:59.851282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:26:59.851282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:26:59.851282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:26:59.851282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 262e54dc-8819-4689-ad3a-577f966f5a21 could not be found. Aug 09 18:26:59.851282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:59.851282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:26:59.851282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:59.851282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:59.851282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:26:59.851282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:26:59.851282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:26:59.851282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:26:59.851282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:26:59.852847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:26:59.852847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:26:59.852847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:26:59.852847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:26:59.852847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:26:59.852847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:26:59.852847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:26:59.852847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 262e54dc-8819-4689-ad3a-577f966f5a21 could not be found. Aug 09 18:26:59.852847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:59.852847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:26:59.852847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:59.852847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:59.852847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:26:59.852847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:26:59.852847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:26:59.852847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:26:59.852847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 262e54dc-8819-4689-ad3a-577f966f5a21 could not be found. Aug 09 18:26:59.852847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:26:59.854222 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f82136a5-24f6-4a31-9be6-1e85a44b0f26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Returning 404 to user: Instance 262e54dc-8819-4689-ad3a-577f966f5a21 could not be found. {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:26:59.854222 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f82136a5-24f6-4a31-9be6-1e85a44b0f26 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 404 len: 111 microversion: 2.20 time: 0.033362 Aug 09 18:26:59.854222 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 485/992] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:26:59 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 09 18:26:59.859167 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-526eb62e-679a-40a0-9862-30e35b15c166 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '.version_select at 0x7f4c351b3160>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:59.930298 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-526eb62e-679a-40a0-9862-30e35b15c166 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-383451288" status: 204 len: 0 microversion: 2.20 time: 0.075082 Aug 09 18:26:59.931170 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 508/993] 10.222.0.36 () {60 vars in 1259 bytes} [Tue Aug 9 18:26:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-383451288 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 09 18:27:00.344454 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-68daa27d-d592-48e0-b619-987bf5d86e86 req-a4b0ccc7-1b41-43f1-87b6-7a7149cc6d11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c609d78-f837-46cf-b7fa-4e65f8936312", "tag": "e0441c86-8951-4cbd-8571-5195188f6127"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:27:00.354405 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-68daa27d-d592-48e0-b619-987bf5d86e86 req-a4b0ccc7-1b41-43f1-87b6-7a7149cc6d11 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:00.355349 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-68daa27d-d592-48e0-b619-987bf5d86e86 req-a4b0ccc7-1b41-43f1-87b6-7a7149cc6d11 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:00.358470 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-68daa27d-d592-48e0-b619-987bf5d86e86 req-a4b0ccc7-1b41-43f1-87b6-7a7149cc6d11 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:00.367873 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-68daa27d-d592-48e0-b619-987bf5d86e86 req-a4b0ccc7-1b41-43f1-87b6-7a7149cc6d11 service nova] Creating event network-changed:e0441c86-8951-4cbd-8571-5195188f6127 for instance 4c609d78-f837-46cf-b7fa-4e65f8936312 on hv-cinder-79797 Aug 09 18:27:00.372960 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-68daa27d-d592-48e0-b619-987bf5d86e86 req-a4b0ccc7-1b41-43f1-87b6-7a7149cc6d11 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032480 Aug 09 18:27:00.373756 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 486/994] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:27:00.848634 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-fa10977d-ae9e-47f4-88e3-0360cb780381 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:00.849240 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-fa10977d-ae9e-47f4-88e3-0360cb780381 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:00.855935 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fa10977d-ae9e-47f4-88e3-0360cb780381 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:00.856737 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fa10977d-ae9e-47f4-88e3-0360cb780381 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:00.857272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fa10977d-ae9e-47f4-88e3-0360cb780381 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:00.857955 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fa10977d-ae9e-47f4-88e3-0360cb780381 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:00.858408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fa10977d-ae9e-47f4-88e3-0360cb780381 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:00.858936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fa10977d-ae9e-47f4-88e3-0360cb780381 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:00.991997 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-fa10977d-ae9e-47f4-88e3-0360cb780381 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:27:01.006507 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-fa10977d-ae9e-47f4-88e3-0360cb780381 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312" status: 200 len: 1364 microversion: 2.1 time: 0.162071 Aug 09 18:27:01.007358 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 509/995] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:27:00 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:27:02.028434 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-b8c7ad9d-abc3-4bb3-8447-194e1301c87a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:02.029122 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-b8c7ad9d-abc3-4bb3-8447-194e1301c87a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:02.035320 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8c7ad9d-abc3-4bb3-8447-194e1301c87a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:02.035819 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8c7ad9d-abc3-4bb3-8447-194e1301c87a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:02.036254 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8c7ad9d-abc3-4bb3-8447-194e1301c87a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:02.036950 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8c7ad9d-abc3-4bb3-8447-194e1301c87a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:02.037409 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8c7ad9d-abc3-4bb3-8447-194e1301c87a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:02.037840 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8c7ad9d-abc3-4bb3-8447-194e1301c87a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:02.050760 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-06846339-ffa3-4cf0-bc1b-b250db71c74f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:02.051810 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-06846339-ffa3-4cf0-bc1b-b250db71c74f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:02.058066 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-06846339-ffa3-4cf0-bc1b-b250db71c74f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:02.058642 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-06846339-ffa3-4cf0-bc1b-b250db71c74f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:02.059118 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-06846339-ffa3-4cf0-bc1b-b250db71c74f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:02.059812 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-06846339-ffa3-4cf0-bc1b-b250db71c74f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:02.060271 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-06846339-ffa3-4cf0-bc1b-b250db71c74f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:02.060695 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-06846339-ffa3-4cf0-bc1b-b250db71c74f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:02.074467 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-06846339-ffa3-4cf0-bc1b-b250db71c74f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] HTTP exception thrown: Instance 262e54dc-8819-4689-ad3a-577f966f5a21 could not be found. Aug 09 18:27:02.076175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-06846339-ffa3-4cf0-bc1b-b250db71c74f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Request method failure captured: Aug 09 18:27:02.076175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: DELETE /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 HTTP/1.1 Aug 09 18:27:02.076175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:27:02.076175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:27:02.076175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:27:02.076175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:27:02.076175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:27:02.076175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:27:02.076175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:27:02.076175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:27:02.076175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qRH6oZvLYQzHHN5HiJQoKEuKN1gFCTx2nB6hBKLAZJDo6gRYlnHyk5KBDlF_RxYLpSZ8RIGNpVqT6M5QMjE12ok36SKMDQPp8Ay9fDGma13RsX7D6onn9MKNQ_v3NCaONsTOjUgfR_mpEXkOb0e1XxZoskKzZdOnHgLXtUDhf6O6JQ Aug 09 18:27:02.076175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:27:02.076175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:27:02.076175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:27:02.076175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:27:02.076175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 18:27:02.076175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:27:02.076175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:27:02.076175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: ac2e5c4bafff4b16bb9d82dacb5dd056 Aug 09 18:27:02.076175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-344752246 Aug 09 18:27:02.076175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:27:02.076175 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:27:02.077859 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ac2e5c4bafff4b16bb9d82dacb5dd056"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ac2e5c4bafff4b16bb9d82dacb5dd056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ac2e5c4bafff4b16bb9d82dacb5dd056", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ac2e5c4bafff4b16bb9d82dacb5dd056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:27:02.077859 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-AttachVolumeShelveTestJSON-344752246 Aug 09 18:27:02.077859 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: ac2e5c4bafff4b16bb9d82dacb5dd056 Aug 09 18:27:02.077859 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-344752246 Aug 09 18:27:02.077859 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-AttachVolumeShelveTestJSON-344752246-project Aug 09 18:27:02.077859 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:27:02.077859 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:27:02.077859 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: 528811040ede40bdb40e3e6e666d283d Aug 09 18:27:02.077859 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-AttachVolumeShelveTestJSON-344752246-project Aug 09 18:27:02.077859 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:27:02.077859 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Instance 262e54dc-8819-4689-ad3a-577f966f5a21 could not be found. Aug 09 18:27:02.077859 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': '262e54dc-8819-4689-ad3a-577f966f5a21'} Aug 09 18:27:02.078757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:27:02.078757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:27:02.078757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:27:02.078757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:27:02.078757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:27:02.078757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:27:02.078757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:27:02.078757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:27:02.078757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:27:02.078757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:27:02.078757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 262e54dc-8819-4689-ad3a-577f966f5a21 could not be found. Aug 09 18:27:02.078757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:27:02.078757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:27:02.078757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:27:02.078757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:27:02.078757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:27:02.078757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:27:02.078757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:27:02.078757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:27:02.078757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:27:02.081100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:27:02.081100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:27:02.081100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:27:02.081100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:27:02.081100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:27:02.081100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:27:02.081100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:27:02.081100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:27:02.081100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:27:02.081100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 262e54dc-8819-4689-ad3a-577f966f5a21 could not be found. Aug 09 18:27:02.081100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:27:02.081100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:27:02.081100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:27:02.081100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:27:02.081100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:27:02.081100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:27:02.081100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:27:02.081100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:27:02.081100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 262e54dc-8819-4689-ad3a-577f966f5a21 could not be found. Aug 09 18:27:02.081100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:27:02.082629 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-06846339-ffa3-4cf0-bc1b-b250db71c74f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Returning 404 to user: Instance 262e54dc-8819-4689-ad3a-577f966f5a21 could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:27:02.082629 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-06846339-ffa3-4cf0-bc1b-b250db71c74f tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "DELETE /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 404 len: 111 microversion: 2.20 time: 0.030676 Aug 09 18:27:02.082629 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 510/996] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Aug 9 18:27:02 2022] DELETE /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 09 18:27:02.087120 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e2f38565-9166-43c8-9fd8-f260829b5239 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:02.087819 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e2f38565-9166-43c8-9fd8-f260829b5239 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 262e54dc-8819-4689-ad3a-577f966f5a21] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:02.093639 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e2f38565-9166-43c8-9fd8-f260829b5239 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:02.094131 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e2f38565-9166-43c8-9fd8-f260829b5239 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:02.094571 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e2f38565-9166-43c8-9fd8-f260829b5239 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:02.095375 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e2f38565-9166-43c8-9fd8-f260829b5239 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:02.095833 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e2f38565-9166-43c8-9fd8-f260829b5239 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:02.096259 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e2f38565-9166-43c8-9fd8-f260829b5239 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:02.109884 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-e2f38565-9166-43c8-9fd8-f260829b5239 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] HTTP exception thrown: Instance 262e54dc-8819-4689-ad3a-577f966f5a21 could not be found. Aug 09 18:27:02.111972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e2f38565-9166-43c8-9fd8-f260829b5239 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Request method failure captured: Aug 09 18:27:02.111972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 HTTP/1.1 Aug 09 18:27:02.111972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:27:02.111972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:27:02.111972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:27:02.111972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:27:02.111972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:27:02.111972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:27:02.111972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:27:02.111972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:27:02.111972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qRH6oZvLYQzHHN5HiJQoKEuKN1gFCTx2nB6hBKLAZJDo6gRYlnHyk5KBDlF_RxYLpSZ8RIGNpVqT6M5QMjE12ok36SKMDQPp8Ay9fDGma13RsX7D6onn9MKNQ_v3NCaONsTOjUgfR_mpEXkOb0e1XxZoskKzZdOnHgLXtUDhf6O6JQ Aug 09 18:27:02.111972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:27:02.111972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:27:02.111972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:27:02.111972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:27:02.111972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 18:27:02.111972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:27:02.111972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:27:02.111972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: ac2e5c4bafff4b16bb9d82dacb5dd056 Aug 09 18:27:02.111972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-344752246 Aug 09 18:27:02.111972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:27:02.111972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:27:02.113658 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ac2e5c4bafff4b16bb9d82dacb5dd056"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ac2e5c4bafff4b16bb9d82dacb5dd056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ac2e5c4bafff4b16bb9d82dacb5dd056", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ac2e5c4bafff4b16bb9d82dacb5dd056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:27:02.113658 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-AttachVolumeShelveTestJSON-344752246 Aug 09 18:27:02.113658 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: ac2e5c4bafff4b16bb9d82dacb5dd056 Aug 09 18:27:02.113658 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-344752246 Aug 09 18:27:02.113658 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-AttachVolumeShelveTestJSON-344752246-project Aug 09 18:27:02.113658 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:27:02.113658 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:27:02.113658 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: 528811040ede40bdb40e3e6e666d283d Aug 09 18:27:02.113658 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-AttachVolumeShelveTestJSON-344752246-project Aug 09 18:27:02.113658 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:27:02.113658 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Instance 262e54dc-8819-4689-ad3a-577f966f5a21 could not be found. Aug 09 18:27:02.113658 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': '262e54dc-8819-4689-ad3a-577f966f5a21'} Aug 09 18:27:02.114483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:27:02.114483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:27:02.114483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:27:02.114483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:27:02.114483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:27:02.114483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:27:02.114483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:27:02.114483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:27:02.114483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:27:02.114483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:27:02.114483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 262e54dc-8819-4689-ad3a-577f966f5a21 could not be found. Aug 09 18:27:02.114483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:27:02.114483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:27:02.114483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:27:02.114483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:27:02.114483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:27:02.114483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:27:02.114483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:27:02.114483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:27:02.114483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:27:02.115908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:27:02.115908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:27:02.115908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:27:02.115908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:27:02.115908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:27:02.115908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:27:02.115908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:27:02.115908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 262e54dc-8819-4689-ad3a-577f966f5a21 could not be found. Aug 09 18:27:02.115908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:27:02.115908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:27:02.115908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:27:02.115908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:27:02.115908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:27:02.115908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:27:02.115908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:27:02.115908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:27:02.115908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 262e54dc-8819-4689-ad3a-577f966f5a21 could not be found. Aug 09 18:27:02.115908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:27:02.117645 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e2f38565-9166-43c8-9fd8-f260829b5239 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Returning 404 to user: Instance 262e54dc-8819-4689-ad3a-577f966f5a21 could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:27:02.117645 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e2f38565-9166-43c8-9fd8-f260829b5239 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21" status: 404 len: 111 microversion: 2.20 time: 0.029935 Aug 09 18:27:02.117645 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 511/997] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:27:02 2022] GET /compute/v2.1/servers/262e54dc-8819-4689-ad3a-577f966f5a21 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 09 18:27:02.178664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-b8c7ad9d-abc3-4bb3-8447-194e1301c87a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:27:02.186311 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-b8c7ad9d-abc3-4bb3-8447-194e1301c87a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312" status: 200 len: 1364 microversion: 2.1 time: 0.162520 Aug 09 18:27:02.186910 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 487/998] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:27:02 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:27:03.207412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a15f2e86-8725-403e-bb8f-aecc1c32f6a1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:03.207949 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a15f2e86-8725-403e-bb8f-aecc1c32f6a1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:03.214359 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a15f2e86-8725-403e-bb8f-aecc1c32f6a1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:03.214876 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a15f2e86-8725-403e-bb8f-aecc1c32f6a1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:03.215317 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a15f2e86-8725-403e-bb8f-aecc1c32f6a1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:03.216006 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a15f2e86-8725-403e-bb8f-aecc1c32f6a1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:03.216461 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a15f2e86-8725-403e-bb8f-aecc1c32f6a1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:03.216881 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a15f2e86-8725-403e-bb8f-aecc1c32f6a1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:03.345480 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a15f2e86-8725-403e-bb8f-aecc1c32f6a1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:27:03.353618 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a15f2e86-8725-403e-bb8f-aecc1c32f6a1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312" status: 200 len: 1364 microversion: 2.1 time: 0.150177 Aug 09 18:27:03.354191 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 512/999] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:27:03 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:27:03.378373 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-b8641210-9075-46da-9422-cf4f7ddd6ef8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:03.378901 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-b8641210-9075-46da-9422-cf4f7ddd6ef8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:03.385385 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8641210-9075-46da-9422-cf4f7ddd6ef8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:03.385871 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8641210-9075-46da-9422-cf4f7ddd6ef8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:03.386334 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8641210-9075-46da-9422-cf4f7ddd6ef8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:03.387055 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8641210-9075-46da-9422-cf4f7ddd6ef8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:03.387508 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8641210-9075-46da-9422-cf4f7ddd6ef8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:03.387936 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b8641210-9075-46da-9422-cf4f7ddd6ef8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:03.401332 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-b8641210-9075-46da-9422-cf4f7ddd6ef8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] HTTP exception thrown: Instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 could not be found. Aug 09 18:27:03.403018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-b8641210-9075-46da-9422-cf4f7ddd6ef8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Request method failure captured: Aug 09 18:27:03.403018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: DELETE /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 HTTP/1.1 Aug 09 18:27:03.403018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:27:03.403018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:27:03.403018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:27:03.403018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 0 Aug 09 18:27:03.403018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:27:03.403018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:27:03.403018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:27:03.403018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:27:03.403018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qRH6oZvLYQzHHN5HiJQoKEuKN1gFCTx2nB6hBKLAZJDo6gRYlnHyk5KBDlF_RxYLpSZ8RIGNpVqT6M5QMjE12ok36SKMDQPp8Ay9fDGma13RsX7D6onn9MKNQ_v3NCaONsTOjUgfR_mpEXkOb0e1XxZoskKzZdOnHgLXtUDhf6O6JQ Aug 09 18:27:03.403018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:27:03.403018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:27:03.403018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:27:03.403018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:27:03.403018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 18:27:03.403018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:27:03.403018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:27:03.403018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: ac2e5c4bafff4b16bb9d82dacb5dd056 Aug 09 18:27:03.403018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-344752246 Aug 09 18:27:03.403018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:27:03.403018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:27:03.404767 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ac2e5c4bafff4b16bb9d82dacb5dd056"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ac2e5c4bafff4b16bb9d82dacb5dd056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ac2e5c4bafff4b16bb9d82dacb5dd056", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ac2e5c4bafff4b16bb9d82dacb5dd056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:27:03.404767 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-AttachVolumeShelveTestJSON-344752246 Aug 09 18:27:03.404767 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: ac2e5c4bafff4b16bb9d82dacb5dd056 Aug 09 18:27:03.404767 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-344752246 Aug 09 18:27:03.404767 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-AttachVolumeShelveTestJSON-344752246-project Aug 09 18:27:03.404767 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:27:03.404767 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:27:03.404767 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: 528811040ede40bdb40e3e6e666d283d Aug 09 18:27:03.404767 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-AttachVolumeShelveTestJSON-344752246-project Aug 09 18:27:03.404767 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: > Aug 09 18:27:03.404767 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 could not be found. Aug 09 18:27:03.404767 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'id': '9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97'} Aug 09 18:27:03.405605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:27:03.405605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:27:03.405605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:27:03.405605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:27:03.405605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:27:03.405605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:27:03.405605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:27:03.405605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:27:03.405605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:27:03.405605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:27:03.405605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 could not be found. Aug 09 18:27:03.405605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:27:03.405605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:27:03.405605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:27:03.405605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:27:03.405605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:27:03.405605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:27:03.405605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:27:03.405605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:27:03.405605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:27:03.407141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:27:03.407141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:27:03.407141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:27:03.407141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:27:03.407141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:27:03.407141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:27:03.407141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:27:03.407141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:27:03.407141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:27:03.407141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 could not be found. Aug 09 18:27:03.407141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:27:03.407141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:27:03.407141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:27:03.407141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:27:03.407141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:27:03.407141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:27:03.407141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:27:03.407141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:27:03.407141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 could not be found. Aug 09 18:27:03.407141 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:27:03.409306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-b8641210-9075-46da-9422-cf4f7ddd6ef8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Returning 404 to user: Instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 could not be found. {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:27:03.409306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-b8641210-9075-46da-9422-cf4f7ddd6ef8 tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 404 len: 111 microversion: 2.20 time: 0.030114 Aug 09 18:27:03.409306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 488/1000] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Aug 9 18:27:03 2022] DELETE /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:27:03.413507 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c3308ce5-333b-42f9-8b05-477c9d08386d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:03.414117 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-c3308ce5-333b-42f9-8b05-477c9d08386d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] [instance: 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:03.420070 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c3308ce5-333b-42f9-8b05-477c9d08386d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:03.420549 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c3308ce5-333b-42f9-8b05-477c9d08386d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:03.420985 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c3308ce5-333b-42f9-8b05-477c9d08386d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:03.421671 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c3308ce5-333b-42f9-8b05-477c9d08386d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:03.422134 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c3308ce5-333b-42f9-8b05-477c9d08386d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:03.422559 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c3308ce5-333b-42f9-8b05-477c9d08386d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:03.436117 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-c3308ce5-333b-42f9-8b05-477c9d08386d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] HTTP exception thrown: Instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 could not be found. Aug 09 18:27:03.437631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c3308ce5-333b-42f9-8b05-477c9d08386d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Request method failure captured: Aug 09 18:27:03.437631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 HTTP/1.1 Aug 09 18:27:03.437631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:27:03.437631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:27:03.437631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:27:03.437631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:27:03.437631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:27:03.437631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:27:03.437631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:27:03.437631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:27:03.437631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qRH6oZvLYQzHHN5HiJQoKEuKN1gFCTx2nB6hBKLAZJDo6gRYlnHyk5KBDlF_RxYLpSZ8RIGNpVqT6M5QMjE12ok36SKMDQPp8Ay9fDGma13RsX7D6onn9MKNQ_v3NCaONsTOjUgfR_mpEXkOb0e1XxZoskKzZdOnHgLXtUDhf6O6JQ Aug 09 18:27:03.437631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:27:03.437631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:27:03.437631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:27:03.437631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:27:03.437631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 18:27:03.437631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:27:03.437631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:27:03.437631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: ac2e5c4bafff4b16bb9d82dacb5dd056 Aug 09 18:27:03.437631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-344752246 Aug 09 18:27:03.437631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:27:03.437631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:27:03.439380 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ac2e5c4bafff4b16bb9d82dacb5dd056"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ac2e5c4bafff4b16bb9d82dacb5dd056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ac2e5c4bafff4b16bb9d82dacb5dd056", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ac2e5c4bafff4b16bb9d82dacb5dd056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:27:03.439380 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-AttachVolumeShelveTestJSON-344752246 Aug 09 18:27:03.439380 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: ac2e5c4bafff4b16bb9d82dacb5dd056 Aug 09 18:27:03.439380 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-344752246 Aug 09 18:27:03.439380 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-AttachVolumeShelveTestJSON-344752246-project Aug 09 18:27:03.439380 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:27:03.439380 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:27:03.439380 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: 528811040ede40bdb40e3e6e666d283d Aug 09 18:27:03.439380 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-AttachVolumeShelveTestJSON-344752246-project Aug 09 18:27:03.439380 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:27:03.439380 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 could not be found. Aug 09 18:27:03.439380 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': '9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97'} Aug 09 18:27:03.440336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:27:03.440336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:27:03.440336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:27:03.440336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:27:03.440336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:27:03.440336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:27:03.440336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:27:03.440336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:27:03.440336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:27:03.440336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:27:03.440336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 could not be found. Aug 09 18:27:03.440336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:27:03.440336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:27:03.440336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:27:03.440336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:27:03.440336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:27:03.440336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:27:03.440336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:27:03.440336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:27:03.440336 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:27:03.441808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:27:03.441808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:27:03.441808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:27:03.441808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:27:03.441808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:27:03.441808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:27:03.441808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:27:03.441808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 could not be found. Aug 09 18:27:03.441808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:27:03.441808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:27:03.441808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:27:03.441808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:27:03.441808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:27:03.441808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:27:03.441808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:27:03.441808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:27:03.441808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 could not be found. Aug 09 18:27:03.441808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:27:03.443159 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c3308ce5-333b-42f9-8b05-477c9d08386d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] Returning 404 to user: Instance 9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:27:03.443159 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-c3308ce5-333b-42f9-8b05-477c9d08386d tempest-AttachVolumeShelveTestJSON-344752246 tempest-AttachVolumeShelveTestJSON-344752246-project] 10.222.0.36 "GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97" status: 404 len: 111 microversion: 2.20 time: 0.029498 Aug 09 18:27:03.443159 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 513/1001] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Aug 9 18:27:03 2022] GET /compute/v2.1/servers/9c5b45e5-7f5b-4e1d-ab9a-1e2ce6033d97 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 09 18:27:04.376237 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-beeac63e-8008-4b80-9a79-252e69496405 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:04.376922 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-beeac63e-8008-4b80-9a79-252e69496405 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:04.380382 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=6 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:27:04.384932 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-beeac63e-8008-4b80-9a79-252e69496405 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:04.385476 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-beeac63e-8008-4b80-9a79-252e69496405 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:04.386260 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-beeac63e-8008-4b80-9a79-252e69496405 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:04.387058 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-beeac63e-8008-4b80-9a79-252e69496405 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:04.387514 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-beeac63e-8008-4b80-9a79-252e69496405 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:04.388101 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-beeac63e-8008-4b80-9a79-252e69496405 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:04.612200 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-beeac63e-8008-4b80-9a79-252e69496405 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:27:04.619910 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-beeac63e-8008-4b80-9a79-252e69496405 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312" status: 200 len: 1364 microversion: 2.1 time: 0.248015 Aug 09 18:27:04.620479 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 489/1002] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:27:04 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:27:05.641054 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-706681ad-152e-4384-8e8b-647f97286d86 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:05.641698 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-706681ad-152e-4384-8e8b-647f97286d86 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:05.644709 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=2 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:27:05.645408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=6 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:27:05.654433 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-706681ad-152e-4384-8e8b-647f97286d86 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:05.658238 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-706681ad-152e-4384-8e8b-647f97286d86 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:05.658238 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-706681ad-152e-4384-8e8b-647f97286d86 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:05.658238 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-706681ad-152e-4384-8e8b-647f97286d86 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:05.658238 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-706681ad-152e-4384-8e8b-647f97286d86 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:05.659022 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-706681ad-152e-4384-8e8b-647f97286d86 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:05.845580 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-706681ad-152e-4384-8e8b-647f97286d86 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:27:05.853330 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-706681ad-152e-4384-8e8b-647f97286d86 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312" status: 200 len: 1364 microversion: 2.1 time: 0.216142 Aug 09 18:27:05.854107 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 514/1003] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:27:05 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:27:06.874959 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-33856e73-e05c-44b0-90f1-f852a779727a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:06.875635 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-33856e73-e05c-44b0-90f1-f852a779727a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:06.882751 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-33856e73-e05c-44b0-90f1-f852a779727a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:06.883520 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-33856e73-e05c-44b0-90f1-f852a779727a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:06.884120 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-33856e73-e05c-44b0-90f1-f852a779727a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:06.885012 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-33856e73-e05c-44b0-90f1-f852a779727a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:06.885639 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-33856e73-e05c-44b0-90f1-f852a779727a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:06.886065 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-33856e73-e05c-44b0-90f1-f852a779727a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:07.039672 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-33856e73-e05c-44b0-90f1-f852a779727a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:27:07.052242 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-33856e73-e05c-44b0-90f1-f852a779727a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312" status: 200 len: 1364 microversion: 2.1 time: 0.181248 Aug 09 18:27:07.053164 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 490/1004] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:27:06 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:27:07.343204 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-fec20bdd-112a-4f83-ade6-02ba0c7eb55c req-a1dc3aa7-5249-49e9-a80a-46785e4baff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c609d78-f837-46cf-b7fa-4e65f8936312", "name": "network-vif-plugged", "status": "completed", "tag": "e0441c86-8951-4cbd-8571-5195188f6127"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:27:07.352640 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-fec20bdd-112a-4f83-ade6-02ba0c7eb55c req-a1dc3aa7-5249-49e9-a80a-46785e4baff5 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:07.353127 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-fec20bdd-112a-4f83-ade6-02ba0c7eb55c req-a1dc3aa7-5249-49e9-a80a-46785e4baff5 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:07.353561 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-fec20bdd-112a-4f83-ade6-02ba0c7eb55c req-a1dc3aa7-5249-49e9-a80a-46785e4baff5 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:07.365434 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-fec20bdd-112a-4f83-ade6-02ba0c7eb55c req-a1dc3aa7-5249-49e9-a80a-46785e4baff5 service nova] Creating event network-vif-plugged:e0441c86-8951-4cbd-8571-5195188f6127 for instance 4c609d78-f837-46cf-b7fa-4e65f8936312 on hv-cinder-79797 Aug 09 18:27:07.371193 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-fec20bdd-112a-4f83-ade6-02ba0c7eb55c req-a1dc3aa7-5249-49e9-a80a-46785e4baff5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101400 Aug 09 18:27:07.371770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 515/1005] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:27:08.073687 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8d8c73f4-70f1-4e4d-8c69-09e4e3a04e59 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:08.074331 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8d8c73f4-70f1-4e4d-8c69-09e4e3a04e59 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:08.080748 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8d8c73f4-70f1-4e4d-8c69-09e4e3a04e59 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:08.081236 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8d8c73f4-70f1-4e4d-8c69-09e4e3a04e59 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:08.081680 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8d8c73f4-70f1-4e4d-8c69-09e4e3a04e59 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:08.082431 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8d8c73f4-70f1-4e4d-8c69-09e4e3a04e59 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:08.082928 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8d8c73f4-70f1-4e4d-8c69-09e4e3a04e59 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:08.083356 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8d8c73f4-70f1-4e4d-8c69-09e4e3a04e59 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:08.217502 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8d8c73f4-70f1-4e4d-8c69-09e4e3a04e59 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:27:08.225401 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8d8c73f4-70f1-4e4d-8c69-09e4e3a04e59 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312" status: 200 len: 1364 microversion: 2.1 time: 0.155656 Aug 09 18:27:08.228584 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 491/1006] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:27:08 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:27:09.247790 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-df608b31-1068-411d-8861-2ac66169df5c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:09.248492 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-df608b31-1068-411d-8861-2ac66169df5c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:09.255251 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-df608b31-1068-411d-8861-2ac66169df5c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:09.255737 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-df608b31-1068-411d-8861-2ac66169df5c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:09.256179 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-df608b31-1068-411d-8861-2ac66169df5c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:09.256868 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-df608b31-1068-411d-8861-2ac66169df5c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:09.257324 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-df608b31-1068-411d-8861-2ac66169df5c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:09.257752 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-df608b31-1068-411d-8861-2ac66169df5c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:09.475212 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-df608b31-1068-411d-8861-2ac66169df5c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:27:09.483385 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-df608b31-1068-411d-8861-2ac66169df5c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312" status: 200 len: 1364 microversion: 2.1 time: 0.240492 Aug 09 18:27:09.483960 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 516/1007] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:27:09 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:27:10.503669 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-0e5519ee-39f4-4e9d-b923-ccbed2f3947f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:10.504287 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-0e5519ee-39f4-4e9d-b923-ccbed2f3947f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:10.510715 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0e5519ee-39f4-4e9d-b923-ccbed2f3947f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:10.511233 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0e5519ee-39f4-4e9d-b923-ccbed2f3947f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:10.511678 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0e5519ee-39f4-4e9d-b923-ccbed2f3947f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:10.512372 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0e5519ee-39f4-4e9d-b923-ccbed2f3947f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:10.512848 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0e5519ee-39f4-4e9d-b923-ccbed2f3947f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:10.513256 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0e5519ee-39f4-4e9d-b923-ccbed2f3947f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:10.648437 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-0e5519ee-39f4-4e9d-b923-ccbed2f3947f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:27:10.656063 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-0e5519ee-39f4-4e9d-b923-ccbed2f3947f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312" status: 200 len: 1554 microversion: 2.1 time: 0.156346 Aug 09 18:27:10.656634 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 492/1008] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:27:10 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:27:10.676647 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6d07043c-a0a0-4e3f-84e1-e8a20081b78f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:10.677141 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-6d07043c-a0a0-4e3f-84e1-e8a20081b78f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:10.683560 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6d07043c-a0a0-4e3f-84e1-e8a20081b78f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:10.684046 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6d07043c-a0a0-4e3f-84e1-e8a20081b78f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:10.684484 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6d07043c-a0a0-4e3f-84e1-e8a20081b78f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:10.685172 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6d07043c-a0a0-4e3f-84e1-e8a20081b78f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:10.685627 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6d07043c-a0a0-4e3f-84e1-e8a20081b78f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:10.686051 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6d07043c-a0a0-4e3f-84e1-e8a20081b78f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:10.769958 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-6d07043c-a0a0-4e3f-84e1-e8a20081b78f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097230 Aug 09 18:27:10.770576 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 517/1009] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Aug 9 18:27:10 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:27:11.783712 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-cf9b64ea-5c76-4af0-8de9-f96a47e36cfd req-301a6162-7f22-4faa-9df0-28ca6b1a12e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c609d78-f837-46cf-b7fa-4e65f8936312", "tag": "e0441c86-8951-4cbd-8571-5195188f6127"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:27:11.793493 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-cf9b64ea-5c76-4af0-8de9-f96a47e36cfd req-301a6162-7f22-4faa-9df0-28ca6b1a12e4 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:11.793979 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-cf9b64ea-5c76-4af0-8de9-f96a47e36cfd req-301a6162-7f22-4faa-9df0-28ca6b1a12e4 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:11.794416 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-cf9b64ea-5c76-4af0-8de9-f96a47e36cfd req-301a6162-7f22-4faa-9df0-28ca6b1a12e4 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:11.808600 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-cf9b64ea-5c76-4af0-8de9-f96a47e36cfd req-301a6162-7f22-4faa-9df0-28ca6b1a12e4 service nova] Creating event network-changed:e0441c86-8951-4cbd-8571-5195188f6127 for instance 4c609d78-f837-46cf-b7fa-4e65f8936312 on hv-cinder-79797 Aug 09 18:27:11.814197 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-cf9b64ea-5c76-4af0-8de9-f96a47e36cfd req-301a6162-7f22-4faa-9df0-28ca6b1a12e4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034651 Aug 09 18:27:11.815703 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 493/1010] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:28:16.608944 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:28:16.609698 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=76 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:28:16.613929 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-eb2724b2-cc40-4157-81e4-79e1c936d45b tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:16.614426 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-eb2724b2-cc40-4157-81e4-79e1c936d45b tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:16.621020 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eb2724b2-cc40-4157-81e4-79e1c936d45b tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:16.621498 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eb2724b2-cc40-4157-81e4-79e1c936d45b tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:16.621971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eb2724b2-cc40-4157-81e4-79e1c936d45b tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:16.622660 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eb2724b2-cc40-4157-81e4-79e1c936d45b tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:16.623137 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eb2724b2-cc40-4157-81e4-79e1c936d45b tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:16.626823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eb2724b2-cc40-4157-81e4-79e1c936d45b tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:16.646511 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-eb2724b2-cc40-4157-81e4-79e1c936d45b tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312/ips" status: 200 len: 150 microversion: 2.1 time: 0.039580 Aug 09 18:28:16.649784 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 518/1011] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Aug 9 18:28:16 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:28:18.386817 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:28:18.387914 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:28:18.392631 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d556bed4-2d9c-46ba-bf02-9e1416a2556d tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6dadbe4c-f268-43b8-b9fa-32f6b38a439a"}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:28:18.395188 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d556bed4-2d9c-46ba-bf02-9e1416a2556d tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:18.401632 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d556bed4-2d9c-46ba-bf02-9e1416a2556d tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:18.402292 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d556bed4-2d9c-46ba-bf02-9e1416a2556d tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:18.402814 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d556bed4-2d9c-46ba-bf02-9e1416a2556d tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:18.403456 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d556bed4-2d9c-46ba-bf02-9e1416a2556d tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:18.403909 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d556bed4-2d9c-46ba-bf02-9e1416a2556d tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:18.404330 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d556bed4-2d9c-46ba-bf02-9e1416a2556d tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:19.085239 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d556bed4-2d9c-46ba-bf02-9e1416a2556d tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "POST /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.701297 Aug 09 18:28:19.085850 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 494/1012] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Aug 9 18:28:18 2022] POST /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312/os-volume_attachments => generated 194 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:28:26.609852 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e48ef65a-6d5b-40de-b485-38ae7908367f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Action: 'create', calling method: .version_select at 0x7f4c354a5a60>, body: {"keypair": {"name": "tempest-keypair-1163275390", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxx9FnFQwRLHblXERzX/lveRzZm84QlyI7PU7EdLIyth2Ga9kJiXbtPx+WO9T0KEYG26Iv5W/ZB4/J1I1BeGlGz/qNfQPqFIapzJn0qF0n9ONMMwdNbZfOxj+uGXZbzag=="}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:28:26.626684 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-e48ef65a-6d5b-40de-b485-38ae7908367f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Getting quotas for project ef103f8a63404f918eaa5dd0c626b4c0. Resources: {'key_pairs'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:28:26.630608 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-e48ef65a-6d5b-40de-b485-38ae7908367f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Getting quotas for user b5ffbaec36054aa3a89cca8b6007c8bb and project ef103f8a63404f918eaa5dd0c626b4c0. Resources: {'key_pairs'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:28:26.722692 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e48ef65a-6d5b-40de-b485-38ae7908367f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.117189 Aug 09 18:28:26.723265 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 519/1013] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Aug 9 18:28:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:28:29.015695 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=2 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:28:29.020451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-9ee1e0ae-0a4a-4eb2-826a-b22b33a505ba tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1987452939", "imageRef": "53732c26-c942-4646-ac3f-8d9e11ab4d57", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b718d6b0-7ac1-48df-9d78-732c5ed8dfb4"}], "security_groups": [{"name": "tempest-securitygroup--1406547224"}], "key_name": "tempest-keypair-1163275390", "user_data": "}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:28:29.028974 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:28:29.125324 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.network.neutron [None req-9ee1e0ae-0a4a-4eb2-826a-b22b33a505ba tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] validate_networks() for [('b718d6b0-7ac1-48df-9d78-732c5ed8dfb4', None, None, None, None, None)] {{(pid=118314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:28:29.590260 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-9ee1e0ae-0a4a-4eb2-826a-b22b33a505ba tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Flavor limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:28:29.590682 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-9ee1e0ae-0a4a-4eb2-826a-b22b33a505ba tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Image limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:28:29.591175 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-9ee1e0ae-0a4a-4eb2-826a-b22b33a505ba tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Flavor pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:28:29.591576 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-9ee1e0ae-0a4a-4eb2-826a-b22b33a505ba tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Image pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:28:29.591981 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-9ee1e0ae-0a4a-4eb2-826a-b22b33a505ba tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:28:29.600541 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9ee1e0ae-0a4a-4eb2-826a-b22b33a505ba tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:29.601017 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9ee1e0ae-0a4a-4eb2-826a-b22b33a505ba tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:29.601445 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9ee1e0ae-0a4a-4eb2-826a-b22b33a505ba tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:29.602155 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9ee1e0ae-0a4a-4eb2-826a-b22b33a505ba tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:29.602601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9ee1e0ae-0a4a-4eb2-826a-b22b33a505ba tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:29.603084 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9ee1e0ae-0a4a-4eb2-826a-b22b33a505ba tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:29.620185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-9ee1e0ae-0a4a-4eb2-826a-b22b33a505ba tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Getting quotas for project ef103f8a63404f918eaa5dd0c626b4c0. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:28:29.623984 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-9ee1e0ae-0a4a-4eb2-826a-b22b33a505ba tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Getting quotas for user b5ffbaec36054aa3a89cca8b6007c8bb and project ef103f8a63404f918eaa5dd0c626b4c0. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:28:29.634471 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-9ee1e0ae-0a4a-4eb2-826a-b22b33a505ba tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Going to run 1 instances... {{(pid=118314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:28:29.636853 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-9ee1e0ae-0a4a-4eb2-826a-b22b33a505ba tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53732c26-c942-4646-ac3f-8d9e11ab4d57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:28:29.746133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-9ee1e0ae-0a4a-4eb2-826a-b22b33a505ba tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.731797 Aug 09 18:28:29.747472 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 495/1014] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Aug 9 18:28:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:28:29.758797 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-3dc71aee-3b9a-4e12-b95a-01e904ee2378 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:29.759440 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-3dc71aee-3b9a-4e12-b95a-01e904ee2378 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:29.819027 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-3dc71aee-3b9a-4e12-b95a-01e904ee2378 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:29.825074 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-3dc71aee-3b9a-4e12-b95a-01e904ee2378 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29" status: 200 len: 1242 microversion: 2.1 time: 0.071084 Aug 09 18:28:29.825634 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 520/1015] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:29 2022] GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:28:30.846261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-31079a9f-8032-4655-9e98-221fe1a7d885 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:30.846912 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-31079a9f-8032-4655-9e98-221fe1a7d885 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:30.854265 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-31079a9f-8032-4655-9e98-221fe1a7d885 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:30.855225 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-31079a9f-8032-4655-9e98-221fe1a7d885 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:30.855662 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-31079a9f-8032-4655-9e98-221fe1a7d885 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:30.856363 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-31079a9f-8032-4655-9e98-221fe1a7d885 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:30.856820 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-31079a9f-8032-4655-9e98-221fe1a7d885 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:30.857250 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-31079a9f-8032-4655-9e98-221fe1a7d885 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:30.917623 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-31079a9f-8032-4655-9e98-221fe1a7d885 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:30.925196 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-31079a9f-8032-4655-9e98-221fe1a7d885 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29" status: 200 len: 1238 microversion: 2.1 time: 0.083633 Aug 09 18:28:30.925878 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 496/1016] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:30 2022] GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29 => generated 1238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:28:31.945432 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e295d0e3-c893-4998-855a-5d5cf06ff345 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:31.946053 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e295d0e3-c893-4998-855a-5d5cf06ff345 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:31.953695 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e295d0e3-c893-4998-855a-5d5cf06ff345 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:31.954188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e295d0e3-c893-4998-855a-5d5cf06ff345 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:31.954631 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e295d0e3-c893-4998-855a-5d5cf06ff345 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:31.955368 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e295d0e3-c893-4998-855a-5d5cf06ff345 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:31.955824 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e295d0e3-c893-4998-855a-5d5cf06ff345 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:31.956255 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e295d0e3-c893-4998-855a-5d5cf06ff345 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:32.030263 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e295d0e3-c893-4998-855a-5d5cf06ff345 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:32.037560 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e295d0e3-c893-4998-855a-5d5cf06ff345 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29" status: 200 len: 1300 microversion: 2.1 time: 0.096035 Aug 09 18:28:32.038133 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 521/1017] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:31 2022] GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29 => generated 1300 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:28:33.060674 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-be016bdf-18dd-4f35-a546-5e2f8bddd0d2 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:33.061267 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-be016bdf-18dd-4f35-a546-5e2f8bddd0d2 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:33.067774 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-be016bdf-18dd-4f35-a546-5e2f8bddd0d2 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:33.068255 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-be016bdf-18dd-4f35-a546-5e2f8bddd0d2 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:33.068686 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-be016bdf-18dd-4f35-a546-5e2f8bddd0d2 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:33.069364 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-be016bdf-18dd-4f35-a546-5e2f8bddd0d2 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:33.069813 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-be016bdf-18dd-4f35-a546-5e2f8bddd0d2 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:33.070238 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-be016bdf-18dd-4f35-a546-5e2f8bddd0d2 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:33.092590 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-ef76f60f-a84c-451c-8207-ae7496952802 req-72f3df93-4fb8-4d38-b6bc-cd73d60c7ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75fbff94-7825-46ec-87c1-04cf653b3c29", "tag": "3fbb0207-690f-4e4d-9f29-9a019998a631"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:28:33.102588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-ef76f60f-a84c-451c-8207-ae7496952802 req-72f3df93-4fb8-4d38-b6bc-cd73d60c7ab9 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:33.104008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-ef76f60f-a84c-451c-8207-ae7496952802 req-72f3df93-4fb8-4d38-b6bc-cd73d60c7ab9 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:33.104740 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-ef76f60f-a84c-451c-8207-ae7496952802 req-72f3df93-4fb8-4d38-b6bc-cd73d60c7ab9 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:33.115894 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-ef76f60f-a84c-451c-8207-ae7496952802 req-72f3df93-4fb8-4d38-b6bc-cd73d60c7ab9 service nova] Creating event network-changed:3fbb0207-690f-4e4d-9f29-9a019998a631 for instance 75fbff94-7825-46ec-87c1-04cf653b3c29 on hv-cinder-79797 Aug 09 18:28:33.122113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-ef76f60f-a84c-451c-8207-ae7496952802 req-72f3df93-4fb8-4d38-b6bc-cd73d60c7ab9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033454 Aug 09 18:28:33.122740 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 522/1018] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:28:33.315361 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-be016bdf-18dd-4f35-a546-5e2f8bddd0d2 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:33.322945 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-be016bdf-18dd-4f35-a546-5e2f8bddd0d2 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29" status: 200 len: 1368 microversion: 2.1 time: 0.267338 Aug 09 18:28:33.323514 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 497/1019] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:33 2022] GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29 => generated 1368 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:28:34.344459 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-224cc710-1e3c-4402-881d-9282d607215f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:34.345071 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-224cc710-1e3c-4402-881d-9282d607215f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:34.351162 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-224cc710-1e3c-4402-881d-9282d607215f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:34.351643 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-224cc710-1e3c-4402-881d-9282d607215f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:34.352078 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-224cc710-1e3c-4402-881d-9282d607215f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:34.352790 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-224cc710-1e3c-4402-881d-9282d607215f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:34.353965 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-224cc710-1e3c-4402-881d-9282d607215f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:34.354663 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-224cc710-1e3c-4402-881d-9282d607215f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:34.487285 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-224cc710-1e3c-4402-881d-9282d607215f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:34.494793 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-224cc710-1e3c-4402-881d-9282d607215f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29" status: 200 len: 1368 microversion: 2.1 time: 0.155042 Aug 09 18:28:34.495366 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 523/1020] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:34 2022] GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:28:35.516117 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c17344bc-8d53-47a0-bafb-7a9f325c14b9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:35.516715 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c17344bc-8d53-47a0-bafb-7a9f325c14b9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:35.523173 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c17344bc-8d53-47a0-bafb-7a9f325c14b9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:35.523653 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c17344bc-8d53-47a0-bafb-7a9f325c14b9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:35.524085 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c17344bc-8d53-47a0-bafb-7a9f325c14b9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:35.524825 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c17344bc-8d53-47a0-bafb-7a9f325c14b9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:35.525999 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c17344bc-8d53-47a0-bafb-7a9f325c14b9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:35.526450 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c17344bc-8d53-47a0-bafb-7a9f325c14b9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:35.654384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c17344bc-8d53-47a0-bafb-7a9f325c14b9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:35.661723 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c17344bc-8d53-47a0-bafb-7a9f325c14b9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29" status: 200 len: 1368 microversion: 2.1 time: 0.149518 Aug 09 18:28:35.662280 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 498/1021] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:35 2022] GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:28:36.682236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-4551eeca-73be-4f7a-82e5-19cd7e7f65d3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:36.683256 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-4551eeca-73be-4f7a-82e5-19cd7e7f65d3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:36.689430 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4551eeca-73be-4f7a-82e5-19cd7e7f65d3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:36.689919 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4551eeca-73be-4f7a-82e5-19cd7e7f65d3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:36.690357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4551eeca-73be-4f7a-82e5-19cd7e7f65d3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:36.691092 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4551eeca-73be-4f7a-82e5-19cd7e7f65d3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:36.691548 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4551eeca-73be-4f7a-82e5-19cd7e7f65d3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:36.691979 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4551eeca-73be-4f7a-82e5-19cd7e7f65d3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:36.820474 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4551eeca-73be-4f7a-82e5-19cd7e7f65d3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:36.828398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-4551eeca-73be-4f7a-82e5-19cd7e7f65d3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29" status: 200 len: 1368 microversion: 2.1 time: 0.150162 Aug 09 18:28:36.828968 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 524/1022] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:36 2022] GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:28:37.849481 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-1ed01150-d582-4d60-b633-980223381991 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:37.850140 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-1ed01150-d582-4d60-b633-980223381991 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:37.858395 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1ed01150-d582-4d60-b633-980223381991 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:37.858916 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1ed01150-d582-4d60-b633-980223381991 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:37.859349 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1ed01150-d582-4d60-b633-980223381991 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:37.860041 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1ed01150-d582-4d60-b633-980223381991 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:37.860486 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1ed01150-d582-4d60-b633-980223381991 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:37.860975 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1ed01150-d582-4d60-b633-980223381991 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:37.995077 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-1ed01150-d582-4d60-b633-980223381991 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:38.002655 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-1ed01150-d582-4d60-b633-980223381991 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29" status: 200 len: 1368 microversion: 2.1 time: 0.157043 Aug 09 18:28:38.003262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 499/1023] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:37 2022] GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:28:39.023546 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-624d99e3-556e-4da7-95e1-392fcdbeca2c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:39.024154 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-624d99e3-556e-4da7-95e1-392fcdbeca2c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:39.030942 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-624d99e3-556e-4da7-95e1-392fcdbeca2c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:39.031422 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-624d99e3-556e-4da7-95e1-392fcdbeca2c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:39.031854 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-624d99e3-556e-4da7-95e1-392fcdbeca2c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:39.032532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-624d99e3-556e-4da7-95e1-392fcdbeca2c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:39.033061 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-624d99e3-556e-4da7-95e1-392fcdbeca2c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:39.033483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-624d99e3-556e-4da7-95e1-392fcdbeca2c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:39.161910 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-624d99e3-556e-4da7-95e1-392fcdbeca2c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:39.169992 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-624d99e3-556e-4da7-95e1-392fcdbeca2c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29" status: 200 len: 1368 microversion: 2.1 time: 0.150321 Aug 09 18:28:39.170571 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 525/1024] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:39 2022] GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:28:39.719053 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-94e6ba0e-66a2-480b-95e7-a21219533e90 req-38743798-64a4-4bdf-af79-d87347ac849a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75fbff94-7825-46ec-87c1-04cf653b3c29", "name": "network-vif-plugged", "status": "completed", "tag": "3fbb0207-690f-4e4d-9f29-9a019998a631"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:28:39.725552 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=2 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:28:39.726219 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=6 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:28:39.730437 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-94e6ba0e-66a2-480b-95e7-a21219533e90 req-38743798-64a4-4bdf-af79-d87347ac849a service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:39.730940 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-94e6ba0e-66a2-480b-95e7-a21219533e90 req-38743798-64a4-4bdf-af79-d87347ac849a service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:39.731378 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-94e6ba0e-66a2-480b-95e7-a21219533e90 req-38743798-64a4-4bdf-af79-d87347ac849a service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:39.742006 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-94e6ba0e-66a2-480b-95e7-a21219533e90 req-38743798-64a4-4bdf-af79-d87347ac849a service nova] Creating event network-vif-plugged:3fbb0207-690f-4e4d-9f29-9a019998a631 for instance 75fbff94-7825-46ec-87c1-04cf653b3c29 on hv-cinder-79797 Aug 09 18:28:39.747044 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-94e6ba0e-66a2-480b-95e7-a21219533e90 req-38743798-64a4-4bdf-af79-d87347ac849a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031641 Aug 09 18:28:39.747626 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 500/1025] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:28:40.191543 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e6678d7a-d19a-4d98-abe4-f8d222bab5eb tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:40.192154 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e6678d7a-d19a-4d98-abe4-f8d222bab5eb tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:40.194112 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=6 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:28:40.199428 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e6678d7a-d19a-4d98-abe4-f8d222bab5eb tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:40.199913 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e6678d7a-d19a-4d98-abe4-f8d222bab5eb tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:40.200348 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e6678d7a-d19a-4d98-abe4-f8d222bab5eb tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:40.201039 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e6678d7a-d19a-4d98-abe4-f8d222bab5eb tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:40.201496 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e6678d7a-d19a-4d98-abe4-f8d222bab5eb tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:40.201922 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e6678d7a-d19a-4d98-abe4-f8d222bab5eb tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:40.333973 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e6678d7a-d19a-4d98-abe4-f8d222bab5eb tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:40.342133 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e6678d7a-d19a-4d98-abe4-f8d222bab5eb tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29" status: 200 len: 1368 microversion: 2.1 time: 0.154342 Aug 09 18:28:40.342759 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 526/1026] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:40 2022] GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:28:41.364778 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-6a2109f6-dd1c-458f-a02f-5ae4b0a22f0a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:41.365467 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-6a2109f6-dd1c-458f-a02f-5ae4b0a22f0a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:41.372481 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6a2109f6-dd1c-458f-a02f-5ae4b0a22f0a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:41.372962 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6a2109f6-dd1c-458f-a02f-5ae4b0a22f0a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:41.373390 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6a2109f6-dd1c-458f-a02f-5ae4b0a22f0a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:41.374072 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6a2109f6-dd1c-458f-a02f-5ae4b0a22f0a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:41.374518 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6a2109f6-dd1c-458f-a02f-5ae4b0a22f0a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:41.374969 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6a2109f6-dd1c-458f-a02f-5ae4b0a22f0a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:41.511072 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-6a2109f6-dd1c-458f-a02f-5ae4b0a22f0a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:41.518557 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-6a2109f6-dd1c-458f-a02f-5ae4b0a22f0a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29" status: 200 len: 1368 microversion: 2.1 time: 0.159023 Aug 09 18:28:41.523048 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 501/1027] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:41 2022] GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:28:42.538833 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-68642e57-0bee-4b42-9a55-af39451c0e79 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:42.539451 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-68642e57-0bee-4b42-9a55-af39451c0e79 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:42.546587 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-68642e57-0bee-4b42-9a55-af39451c0e79 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:42.547105 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-68642e57-0bee-4b42-9a55-af39451c0e79 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:42.547550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-68642e57-0bee-4b42-9a55-af39451c0e79 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:42.548243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-68642e57-0bee-4b42-9a55-af39451c0e79 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:42.548702 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-68642e57-0bee-4b42-9a55-af39451c0e79 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:42.549128 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-68642e57-0bee-4b42-9a55-af39451c0e79 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:42.676856 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-68642e57-0bee-4b42-9a55-af39451c0e79 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:42.684650 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-68642e57-0bee-4b42-9a55-af39451c0e79 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29" status: 200 len: 1558 microversion: 2.1 time: 0.149736 Aug 09 18:28:42.685219 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 527/1028] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:42 2022] GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:28:42.706095 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-a2dd47ff-e767-41e8-a459-84c402ca043d tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:42.706635 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-a2dd47ff-e767-41e8-a459-84c402ca043d tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:42.714074 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a2dd47ff-e767-41e8-a459-84c402ca043d tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:42.721278 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a2dd47ff-e767-41e8-a459-84c402ca043d tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:42.721278 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a2dd47ff-e767-41e8-a459-84c402ca043d tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:42.721278 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a2dd47ff-e767-41e8-a459-84c402ca043d tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:42.721278 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a2dd47ff-e767-41e8-a459-84c402ca043d tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:42.721666 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a2dd47ff-e767-41e8-a459-84c402ca043d tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:42.793308 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-a2dd47ff-e767-41e8-a459-84c402ca043d tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091062 Aug 09 18:28:42.793903 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 502/1029] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Aug 9 18:28:42 2022] GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:28:44.375913 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-6c656b34-b27a-4c30-b928-8e73095c3e9d req-f98e9cc1-381c-4d6b-85b6-a7341123f524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75fbff94-7825-46ec-87c1-04cf653b3c29", "tag": "3fbb0207-690f-4e4d-9f29-9a019998a631"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:28:44.387125 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-6c656b34-b27a-4c30-b928-8e73095c3e9d req-f98e9cc1-381c-4d6b-85b6-a7341123f524 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:44.387611 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-6c656b34-b27a-4c30-b928-8e73095c3e9d req-f98e9cc1-381c-4d6b-85b6-a7341123f524 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:44.388045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-6c656b34-b27a-4c30-b928-8e73095c3e9d req-f98e9cc1-381c-4d6b-85b6-a7341123f524 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:44.399038 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-6c656b34-b27a-4c30-b928-8e73095c3e9d req-f98e9cc1-381c-4d6b-85b6-a7341123f524 service nova] Creating event network-changed:3fbb0207-690f-4e4d-9f29-9a019998a631 for instance 75fbff94-7825-46ec-87c1-04cf653b3c29 on hv-cinder-79797 Aug 09 18:28:44.405023 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-6c656b34-b27a-4c30-b928-8e73095c3e9d req-f98e9cc1-381c-4d6b-85b6-a7341123f524 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032847 Aug 09 18:28:44.405652 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 528/1030] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:28:57.611335 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:28:57.612012 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Tue Aug 9 18:28:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:29:59.701561 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:29:59.702324 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=38 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:29:59.706569 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-aa6fc361-302b-4514-b6af-c24e09e6ec94 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:29:59.713959 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-aa6fc361-302b-4514-b6af-c24e09e6ec94 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:29:59.713959 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aa6fc361-302b-4514-b6af-c24e09e6ec94 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:59.713959 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aa6fc361-302b-4514-b6af-c24e09e6ec94 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:59.713959 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aa6fc361-302b-4514-b6af-c24e09e6ec94 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:59.714403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aa6fc361-302b-4514-b6af-c24e09e6ec94 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:59.714969 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aa6fc361-302b-4514-b6af-c24e09e6ec94 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:59.715343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aa6fc361-302b-4514-b6af-c24e09e6ec94 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:59.740086 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-aa6fc361-302b-4514-b6af-c24e09e6ec94 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29/ips" status: 200 len: 149 microversion: 2.1 time: 0.040592 Aug 09 18:29:59.740657 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 503/1031] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Aug 9 18:29:59 2022] GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:29:59.750976 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:29:59.751783 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=44 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:29:59.756693 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-888a8d4b-1a71-4049-9a51-d908aa1f2e33 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6dadbe4c-f268-43b8-b9fa-32f6b38a439a"}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:29:59.759097 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-888a8d4b-1a71-4049-9a51-d908aa1f2e33 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:29:59.765094 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-888a8d4b-1a71-4049-9a51-d908aa1f2e33 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:59.765600 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-888a8d4b-1a71-4049-9a51-d908aa1f2e33 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:59.766020 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-888a8d4b-1a71-4049-9a51-d908aa1f2e33 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:59.766727 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-888a8d4b-1a71-4049-9a51-d908aa1f2e33 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:59.767198 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-888a8d4b-1a71-4049-9a51-d908aa1f2e33 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:59.767716 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-888a8d4b-1a71-4049-9a51-d908aa1f2e33 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:59.848420 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-888a8d4b-1a71-4049-9a51-d908aa1f2e33 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] HTTP exception thrown: Invalid volume: volume 6dadbe4c-f268-43b8-b9fa-32f6b38a439a is already attached to instances: 4c609d78-f837-46cf-b7fa-4e65f8936312 Aug 09 18:29:59.850211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-888a8d4b-1a71-4049-9a51-d908aa1f2e33 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Request method failure captured: Aug 09 18:29:59.850211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: POST /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29/os-volume_attachments HTTP/1.1 Aug 09 18:29:59.850211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:29:59.850211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:29:59.850211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:29:59.850211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 74 Aug 09 18:29:59.850211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:29:59.850211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:29:59.850211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:29:59.850211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:29:59.850211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qbq-DOR3BxtGwkou5FwWz3xCIphiCip_GcoqUJfS6TCAlx9byuBwIsmvUqfP7bc54bYmFRCJl-p5wNCqL_fYghaK74o19PAt7cT5_Jm9E5N7e6fbCSxsZ4jxot64kXs_bht-AoiM83Iuo9LFBE11D8xofJdBHQ3q85AlPLOazPfMOg Aug 09 18:29:59.850211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:29:59.850211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:29:59.850211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:29:59.850211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:29:59.850211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:29:59.850211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:29:59.850211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:29:59.850211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:29:59.850211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:29:59.850211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:29:59.851915 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ef103f8a63404f918eaa5dd0c626b4c0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:29:59.851915 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:29:59.851915 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:29:59.851915 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:29:59.851915 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:29:59.851915 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:29:59.851915 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:29:59.851915 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: b5ffbaec36054aa3a89cca8b6007c8bb Aug 09 18:29:59.851915 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:29:59.851915 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Aug 09 18:29:59.851915 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {"volumeAttachment": {"volumeId": "6dadbe4c-f268-43b8-b9fa-32f6b38a439a"}} Aug 09 18:29:59.851915 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:29:59.853031 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Invalid volume: volume 6dadbe4c-f268-43b8-b9fa-32f6b38a439a is already attached to instances: 4c609d78-f837-46cf-b7fa-4e65f8936312 Aug 09 18:29:59.853031 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'server_id': '75fbff94-7825-46ec-87c1-04cf653b3c29', 'body': {'volumeAttachment': {'volumeId': '6dadbe4c-f268-43b8-b9fa-32f6b38a439a'}}} Aug 09 18:29:59.853031 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:29:59.853031 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:29:59.853031 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 18:29:59.853031 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 18:29:59.853031 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 18:29:59.853031 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 18:29:59.853031 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 18:29:59.853031 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 18:29:59.853031 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 09 18:29:59.853031 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 18:29:59.853031 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 09 18:29:59.853031 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 18:29:59.853031 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6dadbe4c-f268-43b8-b9fa-32f6b38a439a is already attached to instances: 4c609d78-f837-46cf-b7fa-4e65f8936312 Aug 09 18:29:59.853031 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:29:59.853031 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:29:59.853031 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:29:59.853031 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:29:59.854365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:29:59.854365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:29:59.854365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:29:59.854365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:29:59.854365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:29:59.854365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:29:59.854365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:29:59.854365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:29:59.854365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:29:59.854365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:29:59.854365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:29:59.854365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:29:59.854365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 18:29:59.854365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 18:29:59.854365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6dadbe4c-f268-43b8-b9fa-32f6b38a439a is already attached to instances: 4c609d78-f837-46cf-b7fa-4e65f8936312 Aug 09 18:29:59.854365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:29:59.854365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:29:59.854365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:29:59.854365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:29:59.854365 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:29:59.855687 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:29:59.855687 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:29:59.855687 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:29:59.855687 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6dadbe4c-f268-43b8-b9fa-32f6b38a439a is already attached to instances: 4c609d78-f837-46cf-b7fa-4e65f8936312 Aug 09 18:29:59.855687 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:29:59.855687 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-888a8d4b-1a71-4049-9a51-d908aa1f2e33 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Returning 400 to user: Invalid volume: volume 6dadbe4c-f268-43b8-b9fa-32f6b38a439a is already attached to instances: 4c609d78-f837-46cf-b7fa-4e65f8936312 {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:29:59.855687 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-888a8d4b-1a71-4049-9a51-d908aa1f2e33 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "POST /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102668 Aug 09 18:29:59.855687 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 529/1032] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Aug 9 18:29:59 2022] POST /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 18:29:59.861088 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-13854084-17ea-490c-aae2-24b954ac5917 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:29:59.861865 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-13854084-17ea-490c-aae2-24b954ac5917 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:29:59.868444 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-13854084-17ea-490c-aae2-24b954ac5917 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:59.868926 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-13854084-17ea-490c-aae2-24b954ac5917 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:59.869361 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-13854084-17ea-490c-aae2-24b954ac5917 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:59.870039 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-13854084-17ea-490c-aae2-24b954ac5917 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:59.870484 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-13854084-17ea-490c-aae2-24b954ac5917 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:59.870929 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-13854084-17ea-490c-aae2-24b954ac5917 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:59.896332 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-13854084-17ea-490c-aae2-24b954ac5917 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] Going to try to terminate instance {{(pid=118314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:30:00.113520 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-13854084-17ea-490c-aae2-24b954ac5917 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "DELETE /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29" status: 204 len: 0 microversion: 2.1 time: 0.256485 Aug 09 18:30:00.114107 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 504/1033] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:29:59 2022] DELETE /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:30:00.122270 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d90a6d05-733e-4fb7-85f6-adfb08d89125 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:00.123120 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d90a6d05-733e-4fb7-85f6-adfb08d89125 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:00.129671 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d90a6d05-733e-4fb7-85f6-adfb08d89125 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:00.130157 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d90a6d05-733e-4fb7-85f6-adfb08d89125 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:00.130598 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d90a6d05-733e-4fb7-85f6-adfb08d89125 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:00.131319 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d90a6d05-733e-4fb7-85f6-adfb08d89125 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:00.131780 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d90a6d05-733e-4fb7-85f6-adfb08d89125 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:00.132211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d90a6d05-733e-4fb7-85f6-adfb08d89125 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:00.266081 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d90a6d05-733e-4fb7-85f6-adfb08d89125 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:00.273866 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d90a6d05-733e-4fb7-85f6-adfb08d89125 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29" status: 200 len: 1682 microversion: 2.1 time: 0.155465 Aug 09 18:30:00.274432 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 530/1034] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:00 2022] GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:30:01.295529 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-10daf3a0-d2e3-4d4e-bba7-00d6d9ed3eea tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:01.296221 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-10daf3a0-d2e3-4d4e-bba7-00d6d9ed3eea tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:01.303257 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-10daf3a0-d2e3-4d4e-bba7-00d6d9ed3eea tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:01.303740 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-10daf3a0-d2e3-4d4e-bba7-00d6d9ed3eea tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:01.304178 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-10daf3a0-d2e3-4d4e-bba7-00d6d9ed3eea tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:01.304860 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-10daf3a0-d2e3-4d4e-bba7-00d6d9ed3eea tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:01.305309 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-10daf3a0-d2e3-4d4e-bba7-00d6d9ed3eea tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:01.305728 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-10daf3a0-d2e3-4d4e-bba7-00d6d9ed3eea tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:01.433833 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-10daf3a0-d2e3-4d4e-bba7-00d6d9ed3eea tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:01.441546 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-10daf3a0-d2e3-4d4e-bba7-00d6d9ed3eea tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29" status: 200 len: 1682 microversion: 2.1 time: 0.150234 Aug 09 18:30:01.442104 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 505/1035] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:01 2022] GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:30:02.463182 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-3c222c23-038e-4260-9776-6385898427c3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:02.463798 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-3c222c23-038e-4260-9776-6385898427c3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:02.470894 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3c222c23-038e-4260-9776-6385898427c3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:02.471287 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3c222c23-038e-4260-9776-6385898427c3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:02.471732 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3c222c23-038e-4260-9776-6385898427c3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:02.472482 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3c222c23-038e-4260-9776-6385898427c3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:02.472943 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3c222c23-038e-4260-9776-6385898427c3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:02.473375 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3c222c23-038e-4260-9776-6385898427c3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:02.585325 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-3c222c23-038e-4260-9776-6385898427c3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:02.592713 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-3c222c23-038e-4260-9776-6385898427c3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29" status: 200 len: 1614 microversion: 2.1 time: 0.133489 Aug 09 18:30:02.593273 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 531/1036] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:02 2022] GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29 => generated 1614 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:30:02.811246 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-5a364462-f730-4b14-82b2-c1c92df386a6 req-9f17bed7-bd48-4523-8ed7-f0c49d7cb1cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75fbff94-7825-46ec-87c1-04cf653b3c29", "name": "network-vif-deleted", "tag": "3fbb0207-690f-4e4d-9f29-9a019998a631"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:30:02.822802 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-5a364462-f730-4b14-82b2-c1c92df386a6 req-9f17bed7-bd48-4523-8ed7-f0c49d7cb1cf service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:02.822802 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-5a364462-f730-4b14-82b2-c1c92df386a6 req-9f17bed7-bd48-4523-8ed7-f0c49d7cb1cf service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:02.822802 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-5a364462-f730-4b14-82b2-c1c92df386a6 req-9f17bed7-bd48-4523-8ed7-f0c49d7cb1cf service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:02.834068 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-5a364462-f730-4b14-82b2-c1c92df386a6 req-9f17bed7-bd48-4523-8ed7-f0c49d7cb1cf service nova] Creating event network-vif-deleted:3fbb0207-690f-4e4d-9f29-9a019998a631 for instance 75fbff94-7825-46ec-87c1-04cf653b3c29 on hv-cinder-79797 Aug 09 18:30:02.839188 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-5a364462-f730-4b14-82b2-c1c92df386a6 req-9f17bed7-bd48-4523-8ed7-f0c49d7cb1cf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032126 Aug 09 18:30:02.839963 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 506/1037] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:30:03.614112 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-efc7dca3-a9ca-4020-ae27-fee872bf5e56 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:03.614775 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-efc7dca3-a9ca-4020-ae27-fee872bf5e56 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:03.621646 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-efc7dca3-a9ca-4020-ae27-fee872bf5e56 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:03.622141 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-efc7dca3-a9ca-4020-ae27-fee872bf5e56 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:03.622580 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-efc7dca3-a9ca-4020-ae27-fee872bf5e56 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:03.623317 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-efc7dca3-a9ca-4020-ae27-fee872bf5e56 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:03.623780 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-efc7dca3-a9ca-4020-ae27-fee872bf5e56 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:03.624204 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-efc7dca3-a9ca-4020-ae27-fee872bf5e56 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:03.638736 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-efc7dca3-a9ca-4020-ae27-fee872bf5e56 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] HTTP exception thrown: Instance 75fbff94-7825-46ec-87c1-04cf653b3c29 could not be found. Aug 09 18:30:03.640323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-efc7dca3-a9ca-4020-ae27-fee872bf5e56 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Request method failure captured: Aug 09 18:30:03.640323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29 HTTP/1.1 Aug 09 18:30:03.640323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:30:03.640323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:30:03.640323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:30:03.640323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:30:03.640323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:30:03.640323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:30:03.640323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:30:03.640323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:30:03.640323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qbq-DOR3BxtGwkou5FwWz3xCIphiCip_GcoqUJfS6TCAlx9byuBwIsmvUqfP7bc54bYmFRCJl-p5wNCqL_fYghaK74o19PAt7cT5_Jm9E5N7e6fbCSxsZ4jxot64kXs_bht-AoiM83Iuo9LFBE11D8xofJdBHQ3q85AlPLOazPfMOg Aug 09 18:30:03.640323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:30:03.640323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:30:03.640323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:30:03.640323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:30:03.640323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:30:03.640323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:30:03.640323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:30:03.640323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:30:03.640323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:30:03.640323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:30:03.641921 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ef103f8a63404f918eaa5dd0c626b4c0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:30:03.641921 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:30:03.641921 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:30:03.641921 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:30:03.641921 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:30:03.641921 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:30:03.641921 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:30:03.641921 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: b5ffbaec36054aa3a89cca8b6007c8bb Aug 09 18:30:03.641921 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:30:03.641921 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:30:03.641921 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Instance 75fbff94-7825-46ec-87c1-04cf653b3c29 could not be found. Aug 09 18:30:03.641921 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': '75fbff94-7825-46ec-87c1-04cf653b3c29'} Aug 09 18:30:03.647691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:30:03.647691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:30:03.647691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:30:03.647691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:30:03.647691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:30:03.647691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:30:03.647691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:30:03.647691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:30:03.647691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:30:03.647691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:30:03.647691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75fbff94-7825-46ec-87c1-04cf653b3c29 could not be found. Aug 09 18:30:03.647691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:30:03.647691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:30:03.647691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:30:03.647691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:30:03.647691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:30:03.647691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:30:03.647691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:30:03.647691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:30:03.647691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:30:03.649429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:30:03.649429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:30:03.649429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:30:03.649429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:30:03.649429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:30:03.649429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:30:03.649429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:30:03.649429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75fbff94-7825-46ec-87c1-04cf653b3c29 could not be found. Aug 09 18:30:03.649429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:30:03.649429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:30:03.649429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:30:03.649429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:30:03.649429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:30:03.649429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:30:03.649429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:30:03.649429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:30:03.649429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75fbff94-7825-46ec-87c1-04cf653b3c29 could not be found. Aug 09 18:30:03.649429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:30:03.650594 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-efc7dca3-a9ca-4020-ae27-fee872bf5e56 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Returning 404 to user: Instance 75fbff94-7825-46ec-87c1-04cf653b3c29 could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:30:03.650594 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-efc7dca3-a9ca-4020-ae27-fee872bf5e56 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29" status: 404 len: 111 microversion: 2.1 time: 0.032075 Aug 09 18:30:03.650594 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 532/1038] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:03 2022] GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:30:03.652065 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-07752056-b5ae-4da2-b43c-fac61276985c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '.version_select at 0x7f4c351cc040>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:03.749340 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-07752056-b5ae-4da2-b43c-fac61276985c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1163275390" status: 202 len: 0 microversion: 2.1 time: 0.101382 Aug 09 18:30:03.749933 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 507/1039] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Aug 9 18:30:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1163275390 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:30:04.608251 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6af9a364-b8f2-4fc3-aecf-c04d79ff1eb0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:04.608754 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-6af9a364-b8f2-4fc3-aecf-c04d79ff1eb0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:04.615272 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6af9a364-b8f2-4fc3-aecf-c04d79ff1eb0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:04.615858 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6af9a364-b8f2-4fc3-aecf-c04d79ff1eb0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:04.616192 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6af9a364-b8f2-4fc3-aecf-c04d79ff1eb0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:04.616881 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6af9a364-b8f2-4fc3-aecf-c04d79ff1eb0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:04.617341 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6af9a364-b8f2-4fc3-aecf-c04d79ff1eb0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:04.617769 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6af9a364-b8f2-4fc3-aecf-c04d79ff1eb0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:04.697486 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.objects.instance [None req-6af9a364-b8f2-4fc3-aecf-c04d79ff1eb0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lazy-loading 'services' on Instance uuid 4c609d78-f837-46cf-b7fa-4e65f8936312 {{(pid=118313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:30:04.941181 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-6af9a364-b8f2-4fc3-aecf-c04d79ff1eb0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312/os-volume_attachments/6dadbe4c-f268-43b8-b9fa-32f6b38a439a" status: 202 len: 0 microversion: 2.1 time: 0.336514 Aug 09 18:30:04.941728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 533/1040] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Aug 9 18:30:04 2022] DELETE /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312/os-volume_attachments/6dadbe4c-f268-43b8-b9fa-32f6b38a439a => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:30:04.950417 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-702682f5-8c12-4c09-83a2-7dcaabc2e435 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:04.953246 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-702682f5-8c12-4c09-83a2-7dcaabc2e435 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:04.961291 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-702682f5-8c12-4c09-83a2-7dcaabc2e435 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:04.961776 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-702682f5-8c12-4c09-83a2-7dcaabc2e435 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:04.962209 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-702682f5-8c12-4c09-83a2-7dcaabc2e435 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:04.962927 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-702682f5-8c12-4c09-83a2-7dcaabc2e435 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:04.963378 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-702682f5-8c12-4c09-83a2-7dcaabc2e435 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:04.963801 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-702682f5-8c12-4c09-83a2-7dcaabc2e435 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:04.994453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-702682f5-8c12-4c09-83a2-7dcaabc2e435 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048239 Aug 09 18:30:04.995042 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 508/1041] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Aug 9 18:30:04 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:30:06.009015 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-938b72b9-0b34-4223-8dcc-e3924f47a405 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:06.011420 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-938b72b9-0b34-4223-8dcc-e3924f47a405 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:06.018452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-938b72b9-0b34-4223-8dcc-e3924f47a405 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:06.018961 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-938b72b9-0b34-4223-8dcc-e3924f47a405 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:06.019419 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-938b72b9-0b34-4223-8dcc-e3924f47a405 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:06.020113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-938b72b9-0b34-4223-8dcc-e3924f47a405 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:06.020572 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-938b72b9-0b34-4223-8dcc-e3924f47a405 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:06.021000 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-938b72b9-0b34-4223-8dcc-e3924f47a405 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:06.050690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-938b72b9-0b34-4223-8dcc-e3924f47a405 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045943 Aug 09 18:30:06.051280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 534/1042] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Aug 9 18:30:06 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 18:30:06.114204 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-68159305-069d-4afc-865e-fb5473ab6e87 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:06.114774 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-68159305-069d-4afc-865e-fb5473ab6e87 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:06.121147 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-68159305-069d-4afc-865e-fb5473ab6e87 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:06.121630 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-68159305-069d-4afc-865e-fb5473ab6e87 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:06.122068 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-68159305-069d-4afc-865e-fb5473ab6e87 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:06.122826 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-68159305-069d-4afc-865e-fb5473ab6e87 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:06.123284 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-68159305-069d-4afc-865e-fb5473ab6e87 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:06.123711 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-68159305-069d-4afc-865e-fb5473ab6e87 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:06.148934 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-68159305-069d-4afc-865e-fb5473ab6e87 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Going to try to terminate instance {{(pid=118314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:30:06.411163 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-68159305-069d-4afc-865e-fb5473ab6e87 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312" status: 204 len: 0 microversion: 2.1 time: 0.301352 Aug 09 18:30:06.411678 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 509/1043] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:30:06 2022] DELETE /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:30:06.420084 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9bbaf2b5-ae5d-49fe-a7c5-f691de88f5dd tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:06.422250 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9bbaf2b5-ae5d-49fe-a7c5-f691de88f5dd tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:06.427467 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9bbaf2b5-ae5d-49fe-a7c5-f691de88f5dd tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:06.428002 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9bbaf2b5-ae5d-49fe-a7c5-f691de88f5dd tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:06.428441 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9bbaf2b5-ae5d-49fe-a7c5-f691de88f5dd tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:06.429142 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9bbaf2b5-ae5d-49fe-a7c5-f691de88f5dd tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:06.429603 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9bbaf2b5-ae5d-49fe-a7c5-f691de88f5dd tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:06.430031 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9bbaf2b5-ae5d-49fe-a7c5-f691de88f5dd tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:06.559871 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9bbaf2b5-ae5d-49fe-a7c5-f691de88f5dd tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:06.567490 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9bbaf2b5-ae5d-49fe-a7c5-f691de88f5dd tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312" status: 200 len: 1679 microversion: 2.1 time: 0.151381 Aug 09 18:30:06.568054 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 535/1044] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:06 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:30:07.589631 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-5d21b200-7919-4c15-bd12-72492d139de9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:07.590324 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-5d21b200-7919-4c15-bd12-72492d139de9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:07.597611 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d21b200-7919-4c15-bd12-72492d139de9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:07.598094 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d21b200-7919-4c15-bd12-72492d139de9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:07.598529 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d21b200-7919-4c15-bd12-72492d139de9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:07.599260 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d21b200-7919-4c15-bd12-72492d139de9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:07.599716 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d21b200-7919-4c15-bd12-72492d139de9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:07.600138 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d21b200-7919-4c15-bd12-72492d139de9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:07.741298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-5d21b200-7919-4c15-bd12-72492d139de9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:07.749211 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-5d21b200-7919-4c15-bd12-72492d139de9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312" status: 200 len: 1679 microversion: 2.1 time: 0.163792 Aug 09 18:30:07.749777 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 510/1045] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:07 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:30:08.772213 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a76a590d-aee5-41e5-80a4-3192b2f0338c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:08.772986 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a76a590d-aee5-41e5-80a4-3192b2f0338c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:08.780160 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a76a590d-aee5-41e5-80a4-3192b2f0338c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:08.780651 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a76a590d-aee5-41e5-80a4-3192b2f0338c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:08.781091 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a76a590d-aee5-41e5-80a4-3192b2f0338c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:08.781815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a76a590d-aee5-41e5-80a4-3192b2f0338c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:08.782268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a76a590d-aee5-41e5-80a4-3192b2f0338c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:08.782691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a76a590d-aee5-41e5-80a4-3192b2f0338c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:08.884499 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-a76a590d-aee5-41e5-80a4-3192b2f0338c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:08.891978 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a76a590d-aee5-41e5-80a4-3192b2f0338c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312" status: 200 len: 1613 microversion: 2.1 time: 0.125576 Aug 09 18:30:08.892545 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 536/1046] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:08 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 => generated 1613 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:30:09.349012 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-5f628d32-429c-4258-870f-9830b2511ea1 req-d64c63fc-c71e-412a-abbe-133145ee9b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c609d78-f837-46cf-b7fa-4e65f8936312", "name": "network-vif-deleted", "tag": "e0441c86-8951-4cbd-8571-5195188f6127"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:30:09.359155 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-5f628d32-429c-4258-870f-9830b2511ea1 req-d64c63fc-c71e-412a-abbe-133145ee9b1e service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:09.359626 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-5f628d32-429c-4258-870f-9830b2511ea1 req-d64c63fc-c71e-412a-abbe-133145ee9b1e service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:09.360049 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-5f628d32-429c-4258-870f-9830b2511ea1 req-d64c63fc-c71e-412a-abbe-133145ee9b1e service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:09.372670 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-5f628d32-429c-4258-870f-9830b2511ea1 req-d64c63fc-c71e-412a-abbe-133145ee9b1e service nova] Creating event network-vif-deleted:e0441c86-8951-4cbd-8571-5195188f6127 for instance 4c609d78-f837-46cf-b7fa-4e65f8936312 on hv-cinder-79797 Aug 09 18:30:09.378894 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-5f628d32-429c-4258-870f-9830b2511ea1 req-d64c63fc-c71e-412a-abbe-133145ee9b1e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033479 Aug 09 18:30:09.379780 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 511/1047] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:30:09.914189 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-599f20cc-79bc-477c-95b2-aaa4fe48d1a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:09.915333 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-599f20cc-79bc-477c-95b2-aaa4fe48d1a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:09.921279 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-599f20cc-79bc-477c-95b2-aaa4fe48d1a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:09.921996 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-599f20cc-79bc-477c-95b2-aaa4fe48d1a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:09.922541 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-599f20cc-79bc-477c-95b2-aaa4fe48d1a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:09.923360 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-599f20cc-79bc-477c-95b2-aaa4fe48d1a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:09.924007 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-599f20cc-79bc-477c-95b2-aaa4fe48d1a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:09.924719 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-599f20cc-79bc-477c-95b2-aaa4fe48d1a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:09.958140 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-599f20cc-79bc-477c-95b2-aaa4fe48d1a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:09.958624 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-599f20cc-79bc-477c-95b2-aaa4fe48d1a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:09.959102 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-599f20cc-79bc-477c-95b2-aaa4fe48d1a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:09.959591 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.objects.instance [None req-599f20cc-79bc-477c-95b2-aaa4fe48d1a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lazy-loading 'fault' on Instance uuid 4c609d78-f837-46cf-b7fa-4e65f8936312 {{(pid=118313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:30:10.006289 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-599f20cc-79bc-477c-95b2-aaa4fe48d1a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:10.014077 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-599f20cc-79bc-477c-95b2-aaa4fe48d1a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312" status: 200 len: 1330 microversion: 2.1 time: 0.103824 Aug 09 18:30:10.014662 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 537/1048] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:09 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:30:11.038391 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-4c8171e0-d750-42bc-b742-5bd39d505bd4 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:11.039100 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-4c8171e0-d750-42bc-b742-5bd39d505bd4 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:11.045887 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4c8171e0-d750-42bc-b742-5bd39d505bd4 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:11.046357 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4c8171e0-d750-42bc-b742-5bd39d505bd4 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:11.046817 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4c8171e0-d750-42bc-b742-5bd39d505bd4 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:11.047498 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4c8171e0-d750-42bc-b742-5bd39d505bd4 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:11.047971 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4c8171e0-d750-42bc-b742-5bd39d505bd4 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:11.048385 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4c8171e0-d750-42bc-b742-5bd39d505bd4 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:11.062295 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-4c8171e0-d750-42bc-b742-5bd39d505bd4 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] HTTP exception thrown: Instance 4c609d78-f837-46cf-b7fa-4e65f8936312 could not be found. Aug 09 18:30:11.063954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-4c8171e0-d750-42bc-b742-5bd39d505bd4 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Request method failure captured: Aug 09 18:30:11.063954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 HTTP/1.1 Aug 09 18:30:11.063954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:30:11.063954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:30:11.063954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:30:11.063954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 0 Aug 09 18:30:11.063954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:30:11.063954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:30:11.063954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:30:11.063954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:30:11.063954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qbq-DOR3BxtGwkou5FwWz3xCIphiCip_GcoqUJfS6TCAlx9byuBwIsmvUqfP7bc54bYmFRCJl-p5wNCqL_fYghaK74o19PAt7cT5_Jm9E5N7e6fbCSxsZ4jxot64kXs_bht-AoiM83Iuo9LFBE11D8xofJdBHQ3q85AlPLOazPfMOg Aug 09 18:30:11.063954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:30:11.063954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:30:11.063954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:30:11.063954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:30:11.063954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:30:11.063954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:30:11.063954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:30:11.063954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:30:11.063954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:30:11.063954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:30:11.065873 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ef103f8a63404f918eaa5dd0c626b4c0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:30:11.065873 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:30:11.065873 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:30:11.065873 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:30:11.065873 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:30:11.065873 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:30:11.065873 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:30:11.065873 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: b5ffbaec36054aa3a89cca8b6007c8bb Aug 09 18:30:11.065873 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:30:11.065873 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: > Aug 09 18:30:11.065873 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Instance 4c609d78-f837-46cf-b7fa-4e65f8936312 could not be found. Aug 09 18:30:11.065873 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'id': '4c609d78-f837-46cf-b7fa-4e65f8936312'} Aug 09 18:30:11.067002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:30:11.067002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:30:11.067002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:30:11.067002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:30:11.067002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:30:11.067002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:30:11.067002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:30:11.067002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:30:11.067002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:30:11.067002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:30:11.067002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c609d78-f837-46cf-b7fa-4e65f8936312 could not be found. Aug 09 18:30:11.067002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:30:11.067002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:30:11.067002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:30:11.067002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:30:11.067002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:30:11.067002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:30:11.067002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:30:11.067002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:30:11.067002 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:30:11.068622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:30:11.068622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:30:11.068622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:30:11.068622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:30:11.068622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:30:11.068622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:30:11.068622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:30:11.068622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c609d78-f837-46cf-b7fa-4e65f8936312 could not be found. Aug 09 18:30:11.068622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:30:11.068622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:30:11.068622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:30:11.068622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:30:11.068622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:30:11.068622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:30:11.068622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:30:11.068622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:30:11.068622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c609d78-f837-46cf-b7fa-4e65f8936312 could not be found. Aug 09 18:30:11.068622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:30:11.070196 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-4c8171e0-d750-42bc-b742-5bd39d505bd4 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Returning 404 to user: Instance 4c609d78-f837-46cf-b7fa-4e65f8936312 could not be found. {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:30:11.070196 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-4c8171e0-d750-42bc-b742-5bd39d505bd4 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312" status: 404 len: 111 microversion: 2.1 time: 0.031858 Aug 09 18:30:11.070196 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 512/1049] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:11 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:30:11.074438 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-7f5963a3-ef3b-4957-bb6a-3bb026f1f5fb tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '.version_select at 0x7f4c35f75940>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:11.137024 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-7f5963a3-ef3b-4957-bb6a-3bb026f1f5fb tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-496154608" status: 202 len: 0 microversion: 2.1 time: 0.066309 Aug 09 18:30:11.137594 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 538/1050] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Aug 9 18:30:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-496154608 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:30:11.877200 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-b9153d55-d3f3-454a-93d1-7eb736109569 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Action: 'create', calling method: .version_select at 0x7f4c352ea9d0>, body: {"keypair": {"name": "tempest-keypair-1885030371", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNocG4KzB+Kf4Zz0UxOnlERc9tYNCMsHh5XZvvn7BIwc5y7JjRuxHkLDv4YgOZYS350mGV6no629hK/0L7OCgdPdXWVchhVNHnyrFi9qq4Bl3/kLT28ynz9v6tDFcAIXmw=="}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:30:11.892891 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-b9153d55-d3f3-454a-93d1-7eb736109569 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Getting quotas for project ef103f8a63404f918eaa5dd0c626b4c0. Resources: {'key_pairs'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:30:11.897512 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-b9153d55-d3f3-454a-93d1-7eb736109569 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Getting quotas for user b5ffbaec36054aa3a89cca8b6007c8bb and project ef103f8a63404f918eaa5dd0c626b4c0. Resources: {'key_pairs'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:30:11.989140 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-b9153d55-d3f3-454a-93d1-7eb736109569 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.115791 Aug 09 18:30:11.989741 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 513/1051] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Aug 9 18:30:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:30:14.164077 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b083fd41-8bf2-457c-9d1a-ec7564573d8f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1372225760", "imageRef": "53732c26-c942-4646-ac3f-8d9e11ab4d57", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b718d6b0-7ac1-48df-9d78-732c5ed8dfb4"}], "security_groups": [{"name": "tempest-securitygroup--958819075"}], "key_name": "tempest-keypair-1885030371", "user_data": "}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:30:14.269806 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.network.neutron [None req-b083fd41-8bf2-457c-9d1a-ec7564573d8f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] validate_networks() for [('b718d6b0-7ac1-48df-9d78-732c5ed8dfb4', None, None, None, None, None)] {{(pid=118313) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:30:14.635581 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-b083fd41-8bf2-457c-9d1a-ec7564573d8f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Flavor limits 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:30:14.636003 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-b083fd41-8bf2-457c-9d1a-ec7564573d8f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Image limits 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:30:14.636509 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-b083fd41-8bf2-457c-9d1a-ec7564573d8f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Flavor pref 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:30:14.636914 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-b083fd41-8bf2-457c-9d1a-ec7564573d8f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Image pref 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:30:14.637321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-b083fd41-8bf2-457c-9d1a-ec7564573d8f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:30:14.646946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b083fd41-8bf2-457c-9d1a-ec7564573d8f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:14.647470 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b083fd41-8bf2-457c-9d1a-ec7564573d8f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:14.647901 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b083fd41-8bf2-457c-9d1a-ec7564573d8f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:14.648619 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b083fd41-8bf2-457c-9d1a-ec7564573d8f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:14.649072 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b083fd41-8bf2-457c-9d1a-ec7564573d8f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:14.649520 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b083fd41-8bf2-457c-9d1a-ec7564573d8f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:14.666193 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-b083fd41-8bf2-457c-9d1a-ec7564573d8f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Getting quotas for project ef103f8a63404f918eaa5dd0c626b4c0. Resources: {'cores', 'instances', 'ram'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:30:14.670061 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-b083fd41-8bf2-457c-9d1a-ec7564573d8f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Getting quotas for user b5ffbaec36054aa3a89cca8b6007c8bb and project ef103f8a63404f918eaa5dd0c626b4c0. Resources: {'cores', 'instances', 'ram'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:30:14.680856 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-b083fd41-8bf2-457c-9d1a-ec7564573d8f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Going to run 1 instances... {{(pid=118313) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:30:14.683111 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-b083fd41-8bf2-457c-9d1a-ec7564573d8f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53732c26-c942-4646-ac3f-8d9e11ab4d57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118313) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:30:14.797268 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b083fd41-8bf2-457c-9d1a-ec7564573d8f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.638522 Aug 09 18:30:14.797817 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 539/1052] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Aug 9 18:30:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:30:14.809567 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-80d5b071-3ac5-45dd-9cf7-68640e1f6a68 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:14.810158 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-80d5b071-3ac5-45dd-9cf7-68640e1f6a68 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:14.865132 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-80d5b071-3ac5-45dd-9cf7-68640e1f6a68 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:14.872154 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-80d5b071-3ac5-45dd-9cf7-68640e1f6a68 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4" status: 200 len: 1242 microversion: 2.1 time: 0.067262 Aug 09 18:30:14.872723 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 514/1053] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:14 2022] GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:30:15.895304 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-78c2e70e-a9e4-49a1-8101-fb3e6ad1c408 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:15.896177 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-78c2e70e-a9e4-49a1-8101-fb3e6ad1c408 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:15.902192 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-78c2e70e-a9e4-49a1-8101-fb3e6ad1c408 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:15.904090 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-78c2e70e-a9e4-49a1-8101-fb3e6ad1c408 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:15.904090 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-78c2e70e-a9e4-49a1-8101-fb3e6ad1c408 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:15.904090 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-78c2e70e-a9e4-49a1-8101-fb3e6ad1c408 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:15.904403 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-78c2e70e-a9e4-49a1-8101-fb3e6ad1c408 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:15.904727 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-78c2e70e-a9e4-49a1-8101-fb3e6ad1c408 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:15.966005 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-78c2e70e-a9e4-49a1-8101-fb3e6ad1c408 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:15.975006 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-78c2e70e-a9e4-49a1-8101-fb3e6ad1c408 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4" status: 200 len: 1238 microversion: 2.1 time: 0.085377 Aug 09 18:30:15.976256 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 540/1054] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:15 2022] GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4 => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:30:16.998410 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-a8545eef-6f7b-492e-ae0f-d2295b1f326b tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:16.999459 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-a8545eef-6f7b-492e-ae0f-d2295b1f326b tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:17.009495 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a8545eef-6f7b-492e-ae0f-d2295b1f326b tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:17.010111 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a8545eef-6f7b-492e-ae0f-d2295b1f326b tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:17.010726 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a8545eef-6f7b-492e-ae0f-d2295b1f326b tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:17.013515 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a8545eef-6f7b-492e-ae0f-d2295b1f326b tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:17.013515 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a8545eef-6f7b-492e-ae0f-d2295b1f326b tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:17.013515 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a8545eef-6f7b-492e-ae0f-d2295b1f326b tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:17.081980 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a8545eef-6f7b-492e-ae0f-d2295b1f326b tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:17.089460 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-a8545eef-6f7b-492e-ae0f-d2295b1f326b tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4" status: 200 len: 1300 microversion: 2.1 time: 0.095466 Aug 09 18:30:17.090038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 515/1055] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:16 2022] GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4 => generated 1300 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:30:18.114647 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5eb7da35-7987-455c-8acd-3bc8f3f27827 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:18.120735 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-5eb7da35-7987-455c-8acd-3bc8f3f27827 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:18.122133 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5eb7da35-7987-455c-8acd-3bc8f3f27827 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:18.122626 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5eb7da35-7987-455c-8acd-3bc8f3f27827 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:18.123091 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5eb7da35-7987-455c-8acd-3bc8f3f27827 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:18.123793 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5eb7da35-7987-455c-8acd-3bc8f3f27827 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:18.124292 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5eb7da35-7987-455c-8acd-3bc8f3f27827 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:18.124730 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5eb7da35-7987-455c-8acd-3bc8f3f27827 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:18.223991 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-d13528ed-54d2-47fe-a00c-99e0769a0d38 req-9efcbbc5-f5bd-477a-ac74-71324c066fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db129123-67b6-4f98-b981-85ae85ddffb4", "tag": "7ec7c092-3683-4177-9937-753b28d73027"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:30:18.235055 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-d13528ed-54d2-47fe-a00c-99e0769a0d38 req-9efcbbc5-f5bd-477a-ac74-71324c066fe2 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:18.235661 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-d13528ed-54d2-47fe-a00c-99e0769a0d38 req-9efcbbc5-f5bd-477a-ac74-71324c066fe2 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:18.236154 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-d13528ed-54d2-47fe-a00c-99e0769a0d38 req-9efcbbc5-f5bd-477a-ac74-71324c066fe2 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:18.248426 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-d13528ed-54d2-47fe-a00c-99e0769a0d38 req-9efcbbc5-f5bd-477a-ac74-71324c066fe2 service nova] Creating event network-changed:7ec7c092-3683-4177-9937-753b28d73027 for instance db129123-67b6-4f98-b981-85ae85ddffb4 on hv-cinder-79797 Aug 09 18:30:18.253960 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-d13528ed-54d2-47fe-a00c-99e0769a0d38 req-9efcbbc5-f5bd-477a-ac74-71324c066fe2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033842 Aug 09 18:30:18.258195 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 516/1056] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:30:18.354760 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-5eb7da35-7987-455c-8acd-3bc8f3f27827 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:18.363036 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-5eb7da35-7987-455c-8acd-3bc8f3f27827 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4" status: 200 len: 1367 microversion: 2.1 time: 0.252720 Aug 09 18:30:18.364017 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 541/1057] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:18 2022] GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:30:19.385382 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-b67a2b28-459b-4f7b-882e-78e67c119284 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:19.386066 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-b67a2b28-459b-4f7b-882e-78e67c119284 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:19.392199 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b67a2b28-459b-4f7b-882e-78e67c119284 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:19.392677 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b67a2b28-459b-4f7b-882e-78e67c119284 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:19.393927 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b67a2b28-459b-4f7b-882e-78e67c119284 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:19.394839 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b67a2b28-459b-4f7b-882e-78e67c119284 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:19.395297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b67a2b28-459b-4f7b-882e-78e67c119284 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:19.395725 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-b67a2b28-459b-4f7b-882e-78e67c119284 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:19.532250 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-b67a2b28-459b-4f7b-882e-78e67c119284 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:19.539960 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-b67a2b28-459b-4f7b-882e-78e67c119284 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4" status: 200 len: 1367 microversion: 2.1 time: 0.159277 Aug 09 18:30:19.540527 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 517/1058] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:19 2022] GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:30:20.561308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c6954fbb-abf0-4482-9312-35c3dab38d20 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:20.561973 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-c6954fbb-abf0-4482-9312-35c3dab38d20 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:20.568550 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c6954fbb-abf0-4482-9312-35c3dab38d20 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:20.569032 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c6954fbb-abf0-4482-9312-35c3dab38d20 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:20.569497 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c6954fbb-abf0-4482-9312-35c3dab38d20 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:20.570191 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c6954fbb-abf0-4482-9312-35c3dab38d20 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:20.570649 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c6954fbb-abf0-4482-9312-35c3dab38d20 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:20.571104 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c6954fbb-abf0-4482-9312-35c3dab38d20 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:20.700226 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-c6954fbb-abf0-4482-9312-35c3dab38d20 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:20.708402 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-c6954fbb-abf0-4482-9312-35c3dab38d20 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4" status: 200 len: 1367 microversion: 2.1 time: 0.150956 Aug 09 18:30:20.708974 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 542/1059] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:20 2022] GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:30:21.728711 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-7cfab889-e65d-48dd-a428-9a70cc351e42 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:21.729268 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-7cfab889-e65d-48dd-a428-9a70cc351e42 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:21.735799 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7cfab889-e65d-48dd-a428-9a70cc351e42 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:21.736282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7cfab889-e65d-48dd-a428-9a70cc351e42 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:21.737439 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7cfab889-e65d-48dd-a428-9a70cc351e42 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:21.738565 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7cfab889-e65d-48dd-a428-9a70cc351e42 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:21.739057 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7cfab889-e65d-48dd-a428-9a70cc351e42 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:21.739486 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7cfab889-e65d-48dd-a428-9a70cc351e42 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:21.978204 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-7cfab889-e65d-48dd-a428-9a70cc351e42 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:21.985782 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-7cfab889-e65d-48dd-a428-9a70cc351e42 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4" status: 200 len: 1367 microversion: 2.1 time: 0.261365 Aug 09 18:30:21.986372 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 518/1060] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:21 2022] GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:30:23.006108 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5db717fc-b4ec-4f38-a374-83ca43710fcc tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:23.006726 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-5db717fc-b4ec-4f38-a374-83ca43710fcc tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:23.013291 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5db717fc-b4ec-4f38-a374-83ca43710fcc tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:23.013770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5db717fc-b4ec-4f38-a374-83ca43710fcc tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:23.014200 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5db717fc-b4ec-4f38-a374-83ca43710fcc tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:23.015052 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5db717fc-b4ec-4f38-a374-83ca43710fcc tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:23.015893 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5db717fc-b4ec-4f38-a374-83ca43710fcc tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:23.016337 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5db717fc-b4ec-4f38-a374-83ca43710fcc tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:23.195378 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-5db717fc-b4ec-4f38-a374-83ca43710fcc tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:23.202803 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-5db717fc-b4ec-4f38-a374-83ca43710fcc tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4" status: 200 len: 1367 microversion: 2.1 time: 0.201051 Aug 09 18:30:23.203373 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 543/1061] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:23 2022] GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:30:24.217204 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-03f7c2eb-a3b2-454d-a641-0685907acc1f req-b2946294-85bc-4df2-917b-ff300696316d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db129123-67b6-4f98-b981-85ae85ddffb4", "name": "network-vif-plugged", "status": "completed", "tag": "7ec7c092-3683-4177-9937-753b28d73027"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:30:24.225535 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9061353a-6d9e-48dd-a4e5-107bf8924273 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:24.226228 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9061353a-6d9e-48dd-a4e5-107bf8924273 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:24.228954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-03f7c2eb-a3b2-454d-a641-0685907acc1f req-b2946294-85bc-4df2-917b-ff300696316d service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:24.229436 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-03f7c2eb-a3b2-454d-a641-0685907acc1f req-b2946294-85bc-4df2-917b-ff300696316d service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:24.229865 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-03f7c2eb-a3b2-454d-a641-0685907acc1f req-b2946294-85bc-4df2-917b-ff300696316d service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:24.233183 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9061353a-6d9e-48dd-a4e5-107bf8924273 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:24.233764 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9061353a-6d9e-48dd-a4e5-107bf8924273 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:24.234261 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9061353a-6d9e-48dd-a4e5-107bf8924273 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:24.234979 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9061353a-6d9e-48dd-a4e5-107bf8924273 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:24.235433 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9061353a-6d9e-48dd-a4e5-107bf8924273 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:24.235941 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9061353a-6d9e-48dd-a4e5-107bf8924273 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:24.240907 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-03f7c2eb-a3b2-454d-a641-0685907acc1f req-b2946294-85bc-4df2-917b-ff300696316d service nova] Creating event network-vif-plugged:7ec7c092-3683-4177-9937-753b28d73027 for instance db129123-67b6-4f98-b981-85ae85ddffb4 on hv-cinder-79797 Aug 09 18:30:24.245862 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-03f7c2eb-a3b2-454d-a641-0685907acc1f req-b2946294-85bc-4df2-917b-ff300696316d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032341 Aug 09 18:30:24.246569 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 519/1062] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:30:24.378480 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-9061353a-6d9e-48dd-a4e5-107bf8924273 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:24.385760 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9061353a-6d9e-48dd-a4e5-107bf8924273 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4" status: 200 len: 1367 microversion: 2.1 time: 0.165626 Aug 09 18:30:24.386320 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 544/1063] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:24 2022] GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:30:25.404511 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=6 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:30:25.409861 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-a2881d15-1799-4c99-a5bb-989e41ce6c5a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:25.410587 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-a2881d15-1799-4c99-a5bb-989e41ce6c5a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:25.416869 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a2881d15-1799-4c99-a5bb-989e41ce6c5a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:25.422256 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a2881d15-1799-4c99-a5bb-989e41ce6c5a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:25.422256 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a2881d15-1799-4c99-a5bb-989e41ce6c5a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:25.422256 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a2881d15-1799-4c99-a5bb-989e41ce6c5a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:25.422256 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a2881d15-1799-4c99-a5bb-989e41ce6c5a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:25.422732 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a2881d15-1799-4c99-a5bb-989e41ce6c5a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:25.549205 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a2881d15-1799-4c99-a5bb-989e41ce6c5a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:25.556881 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-a2881d15-1799-4c99-a5bb-989e41ce6c5a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4" status: 200 len: 1367 microversion: 2.1 time: 0.153348 Aug 09 18:30:25.557453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 520/1064] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:25 2022] GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:30:26.577143 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-3e566d97-72eb-43e4-9a96-ef9683616e70 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:26.577761 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-3e566d97-72eb-43e4-9a96-ef9683616e70 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:26.579854 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=2 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:30:26.580651 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=6 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:30:26.585883 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3e566d97-72eb-43e4-9a96-ef9683616e70 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:26.586399 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3e566d97-72eb-43e4-9a96-ef9683616e70 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:26.586878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3e566d97-72eb-43e4-9a96-ef9683616e70 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:26.591081 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3e566d97-72eb-43e4-9a96-ef9683616e70 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:26.591081 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3e566d97-72eb-43e4-9a96-ef9683616e70 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:26.591081 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3e566d97-72eb-43e4-9a96-ef9683616e70 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:26.719870 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-3e566d97-72eb-43e4-9a96-ef9683616e70 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:26.728316 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-3e566d97-72eb-43e4-9a96-ef9683616e70 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4" status: 200 len: 1557 microversion: 2.1 time: 0.155092 Aug 09 18:30:26.728876 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 545/1065] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:26 2022] GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:30:26.748681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-793af278-5bc3-4969-a421-04717f74db20 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:26.749206 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-793af278-5bc3-4969-a421-04717f74db20 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:26.755670 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-793af278-5bc3-4969-a421-04717f74db20 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:26.756144 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-793af278-5bc3-4969-a421-04717f74db20 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:26.756575 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-793af278-5bc3-4969-a421-04717f74db20 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:26.757250 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-793af278-5bc3-4969-a421-04717f74db20 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:26.757696 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-793af278-5bc3-4969-a421-04717f74db20 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:26.758110 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-793af278-5bc3-4969-a421-04717f74db20 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:26.833443 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-793af278-5bc3-4969-a421-04717f74db20 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088508 Aug 09 18:30:26.834035 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 521/1066] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Aug 9 18:30:26 2022] GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:30:28.068136 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-f8472ab6-60d3-4f73-b06b-ed052acf3925 req-78c996da-ab46-4196-a81e-589c26dcc2d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db129123-67b6-4f98-b981-85ae85ddffb4", "tag": "7ec7c092-3683-4177-9937-753b28d73027"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:30:28.077913 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-f8472ab6-60d3-4f73-b06b-ed052acf3925 req-78c996da-ab46-4196-a81e-589c26dcc2d2 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:28.078395 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-f8472ab6-60d3-4f73-b06b-ed052acf3925 req-78c996da-ab46-4196-a81e-589c26dcc2d2 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:28.078860 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-f8472ab6-60d3-4f73-b06b-ed052acf3925 req-78c996da-ab46-4196-a81e-589c26dcc2d2 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:28.090486 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-f8472ab6-60d3-4f73-b06b-ed052acf3925 req-78c996da-ab46-4196-a81e-589c26dcc2d2 service nova] Creating event network-changed:7ec7c092-3683-4177-9937-753b28d73027 for instance db129123-67b6-4f98-b981-85ae85ddffb4 on hv-cinder-79797 Aug 09 18:30:28.095460 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-f8472ab6-60d3-4f73-b06b-ed052acf3925 req-78c996da-ab46-4196-a81e-589c26dcc2d2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031028 Aug 09 18:30:28.097147 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 546/1067] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:31:32.839325 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:31:32.840099 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:31:32.844299 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-1380ce5b-784a-4ea9-99fe-12cb69e24505 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:32.844786 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-1380ce5b-784a-4ea9-99fe-12cb69e24505 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:32.850873 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1380ce5b-784a-4ea9-99fe-12cb69e24505 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:32.851355 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1380ce5b-784a-4ea9-99fe-12cb69e24505 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:32.851795 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1380ce5b-784a-4ea9-99fe-12cb69e24505 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:32.852470 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1380ce5b-784a-4ea9-99fe-12cb69e24505 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:32.852923 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1380ce5b-784a-4ea9-99fe-12cb69e24505 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:32.853483 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1380ce5b-784a-4ea9-99fe-12cb69e24505 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:32.876113 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-1380ce5b-784a-4ea9-99fe-12cb69e24505 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4/ips" status: 200 len: 150 microversion: 2.1 time: 0.039479 Aug 09 18:31:32.876688 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 522/1068] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Aug 9 18:31:32 2022] GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:31:34.423531 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:31:34.424277 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:31:34.428892 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-bac06209-26be-496e-a25f-6c77ee9e6f1c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4113c953-8908-4fc5-8995-5f08d580affa"}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:31:34.432418 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-bac06209-26be-496e-a25f-6c77ee9e6f1c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:34.438413 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bac06209-26be-496e-a25f-6c77ee9e6f1c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:34.438937 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bac06209-26be-496e-a25f-6c77ee9e6f1c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:34.439388 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bac06209-26be-496e-a25f-6c77ee9e6f1c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:34.440075 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bac06209-26be-496e-a25f-6c77ee9e6f1c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:34.440532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bac06209-26be-496e-a25f-6c77ee9e6f1c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:34.440956 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-bac06209-26be-496e-a25f-6c77ee9e6f1c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:35.097959 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-bac06209-26be-496e-a25f-6c77ee9e6f1c tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "POST /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.676267 Aug 09 18:31:35.098570 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 547/1069] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Aug 9 18:31:34 2022] POST /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4/os-volume_attachments => generated 194 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:31:42.624674 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-796c14a8-b366-42b0-86d1-2119382b90f8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4113c953-8908-4fc5-8995-5f08d580affa"}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:31:42.627028 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-796c14a8-b366-42b0-86d1-2119382b90f8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:42.634650 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-796c14a8-b366-42b0-86d1-2119382b90f8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:42.635161 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-796c14a8-b366-42b0-86d1-2119382b90f8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:42.635812 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-796c14a8-b366-42b0-86d1-2119382b90f8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:42.636503 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-796c14a8-b366-42b0-86d1-2119382b90f8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:42.637482 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-796c14a8-b366-42b0-86d1-2119382b90f8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:42.637917 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-796c14a8-b366-42b0-86d1-2119382b90f8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:42.717749 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-796c14a8-b366-42b0-86d1-2119382b90f8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] HTTP exception thrown: Invalid volume: volume 4113c953-8908-4fc5-8995-5f08d580affa is already attached to instances: db129123-67b6-4f98-b981-85ae85ddffb4 Aug 09 18:31:42.718087 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-796c14a8-b366-42b0-86d1-2119382b90f8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Request method failure captured: Aug 09 18:31:42.718087 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: POST /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4/os-volume_attachments HTTP/1.1 Aug 09 18:31:42.718087 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:31:42.718087 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:31:42.718087 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:31:42.718087 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 74 Aug 09 18:31:42.718087 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:31:42.718087 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:31:42.718087 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:31:42.718087 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:31:42.718087 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qbq-DOR3BxtGwkou5FwWz3xCIphiCip_GcoqUJfS6TCAlx9byuBwIsmvUqfP7bc54bYmFRCJl-p5wNCqL_fYghaK74o19PAt7cT5_Jm9E5N7e6fbCSxsZ4jxot64kXs_bht-AoiM83Iuo9LFBE11D8xofJdBHQ3q85AlPLOazPfMOg Aug 09 18:31:42.718087 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:31:42.718087 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:31:42.718087 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:31:42.718087 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:31:42.718087 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:31:42.718087 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:31:42.718087 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:31:42.718087 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:31:42.718087 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:31:42.718087 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:31:42.719822 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ef103f8a63404f918eaa5dd0c626b4c0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:31:42.719822 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:31:42.719822 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:31:42.719822 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:31:42.719822 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:31:42.719822 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:31:42.719822 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:31:42.719822 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: b5ffbaec36054aa3a89cca8b6007c8bb Aug 09 18:31:42.719822 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:31:42.719822 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Aug 09 18:31:42.719822 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {"volumeAttachment": {"volumeId": "4113c953-8908-4fc5-8995-5f08d580affa"}} Aug 09 18:31:42.719822 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: > Aug 09 18:31:42.720742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Invalid volume: volume 4113c953-8908-4fc5-8995-5f08d580affa is already attached to instances: db129123-67b6-4f98-b981-85ae85ddffb4 Aug 09 18:31:42.720742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'server_id': 'db129123-67b6-4f98-b981-85ae85ddffb4', 'body': {'volumeAttachment': {'volumeId': '4113c953-8908-4fc5-8995-5f08d580affa'}}} Aug 09 18:31:42.720742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:31:42.720742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:31:42.720742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 18:31:42.720742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 18:31:42.720742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 18:31:42.720742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 18:31:42.720742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 18:31:42.720742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 18:31:42.720742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 09 18:31:42.720742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 18:31:42.720742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 09 18:31:42.720742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 18:31:42.720742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4113c953-8908-4fc5-8995-5f08d580affa is already attached to instances: db129123-67b6-4f98-b981-85ae85ddffb4 Aug 09 18:31:42.720742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:31:42.720742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:31:42.720742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:31:42.720742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:31:42.722115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:31:42.722115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:31:42.722115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:31:42.722115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:31:42.722115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:31:42.722115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:31:42.722115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:31:42.722115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:31:42.722115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:31:42.722115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:31:42.722115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:31:42.722115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:31:42.722115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 18:31:42.722115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 18:31:42.722115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4113c953-8908-4fc5-8995-5f08d580affa is already attached to instances: db129123-67b6-4f98-b981-85ae85ddffb4 Aug 09 18:31:42.722115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:31:42.722115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:31:42.722115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:31:42.722115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:31:42.722115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:31:42.723513 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:31:42.723513 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:31:42.723513 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:31:42.723513 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4113c953-8908-4fc5-8995-5f08d580affa is already attached to instances: db129123-67b6-4f98-b981-85ae85ddffb4 Aug 09 18:31:42.723513 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:31:42.723513 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-796c14a8-b366-42b0-86d1-2119382b90f8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Returning 400 to user: Invalid volume: volume 4113c953-8908-4fc5-8995-5f08d580affa is already attached to instances: db129123-67b6-4f98-b981-85ae85ddffb4 {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:31:42.723513 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-796c14a8-b366-42b0-86d1-2119382b90f8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "POST /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098889 Aug 09 18:31:42.723513 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 523/1070] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Aug 9 18:31:42 2022] POST /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 18:31:42.786500 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5e25d499-ac5d-44d9-94b2-71ad6c150c52 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:42.787112 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-5e25d499-ac5d-44d9-94b2-71ad6c150c52 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:42.793921 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5e25d499-ac5d-44d9-94b2-71ad6c150c52 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:42.794414 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5e25d499-ac5d-44d9-94b2-71ad6c150c52 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:42.794893 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5e25d499-ac5d-44d9-94b2-71ad6c150c52 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:42.795586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5e25d499-ac5d-44d9-94b2-71ad6c150c52 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:42.796045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5e25d499-ac5d-44d9-94b2-71ad6c150c52 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:42.796475 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5e25d499-ac5d-44d9-94b2-71ad6c150c52 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:42.876746 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.objects.instance [None req-5e25d499-ac5d-44d9-94b2-71ad6c150c52 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lazy-loading 'services' on Instance uuid db129123-67b6-4f98-b981-85ae85ddffb4 {{(pid=118313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:31:43.110609 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-5e25d499-ac5d-44d9-94b2-71ad6c150c52 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "DELETE /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4/os-volume_attachments/4113c953-8908-4fc5-8995-5f08d580affa" status: 202 len: 0 microversion: 2.1 time: 0.328889 Aug 09 18:31:43.111280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 548/1071] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Aug 9 18:31:42 2022] DELETE /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4/os-volume_attachments/4113c953-8908-4fc5-8995-5f08d580affa => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:31:43.120043 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-18b8dbad-32ca-48ab-b17c-b382fcfd1839 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:43.122428 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-18b8dbad-32ca-48ab-b17c-b382fcfd1839 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:43.129419 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-18b8dbad-32ca-48ab-b17c-b382fcfd1839 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:43.129903 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-18b8dbad-32ca-48ab-b17c-b382fcfd1839 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:43.130338 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-18b8dbad-32ca-48ab-b17c-b382fcfd1839 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:43.131062 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-18b8dbad-32ca-48ab-b17c-b382fcfd1839 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:43.131613 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-18b8dbad-32ca-48ab-b17c-b382fcfd1839 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:43.132039 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-18b8dbad-32ca-48ab-b17c-b382fcfd1839 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:43.162003 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-18b8dbad-32ca-48ab-b17c-b382fcfd1839 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046232 Aug 09 18:31:43.167115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 524/1072] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Aug 9 18:31:43 2022] GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:31:44.175991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-cf136831-6c2e-4f15-83e6-5add1df6fd4e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:44.178208 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-cf136831-6c2e-4f15-83e6-5add1df6fd4e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:44.185150 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cf136831-6c2e-4f15-83e6-5add1df6fd4e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:44.185624 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cf136831-6c2e-4f15-83e6-5add1df6fd4e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:44.186059 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cf136831-6c2e-4f15-83e6-5add1df6fd4e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:44.186785 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cf136831-6c2e-4f15-83e6-5add1df6fd4e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:44.187243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cf136831-6c2e-4f15-83e6-5add1df6fd4e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:44.187666 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-cf136831-6c2e-4f15-83e6-5add1df6fd4e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:44.218649 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-cf136831-6c2e-4f15-83e6-5add1df6fd4e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047449 Aug 09 18:31:44.223308 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 549/1073] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Aug 9 18:31:44 2022] GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:31:45.231679 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-bc6f4094-9a7b-4d11-a2c8-0429a2a92bb0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:45.233919 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-bc6f4094-9a7b-4d11-a2c8-0429a2a92bb0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:45.240238 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bc6f4094-9a7b-4d11-a2c8-0429a2a92bb0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:45.240710 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bc6f4094-9a7b-4d11-a2c8-0429a2a92bb0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:45.241136 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bc6f4094-9a7b-4d11-a2c8-0429a2a92bb0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:45.241819 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bc6f4094-9a7b-4d11-a2c8-0429a2a92bb0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:45.242265 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bc6f4094-9a7b-4d11-a2c8-0429a2a92bb0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:45.242682 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-bc6f4094-9a7b-4d11-a2c8-0429a2a92bb0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:45.272704 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-bc6f4094-9a7b-4d11-a2c8-0429a2a92bb0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045249 Aug 09 18:31:45.273284 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 525/1074] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Aug 9 18:31:45 2022] GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 18:31:45.335490 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-246ce053-73db-4ce5-a798-b6d369302614 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:45.336065 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-246ce053-73db-4ce5-a798-b6d369302614 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:45.342526 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-246ce053-73db-4ce5-a798-b6d369302614 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:45.343043 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-246ce053-73db-4ce5-a798-b6d369302614 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:45.343488 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-246ce053-73db-4ce5-a798-b6d369302614 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:45.344191 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-246ce053-73db-4ce5-a798-b6d369302614 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:45.344659 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-246ce053-73db-4ce5-a798-b6d369302614 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:45.345109 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-246ce053-73db-4ce5-a798-b6d369302614 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:45.371006 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-246ce053-73db-4ce5-a798-b6d369302614 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Going to try to terminate instance {{(pid=118313) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:31:45.659439 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-246ce053-73db-4ce5-a798-b6d369302614 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "DELETE /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4" status: 204 len: 0 microversion: 2.1 time: 0.327340 Aug 09 18:31:45.660039 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 550/1075] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:31:45 2022] DELETE /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:31:45.668086 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-9d658e56-2479-45ef-b322-add704fccbbb tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:45.669795 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-9d658e56-2479-45ef-b322-add704fccbbb tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:45.674681 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9d658e56-2479-45ef-b322-add704fccbbb tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:45.675192 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9d658e56-2479-45ef-b322-add704fccbbb tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:45.675627 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9d658e56-2479-45ef-b322-add704fccbbb tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:45.676347 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9d658e56-2479-45ef-b322-add704fccbbb tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:45.676814 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9d658e56-2479-45ef-b322-add704fccbbb tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:45.677227 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9d658e56-2479-45ef-b322-add704fccbbb tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:45.812557 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-9d658e56-2479-45ef-b322-add704fccbbb tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:45.819933 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-9d658e56-2479-45ef-b322-add704fccbbb tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4" status: 200 len: 1682 microversion: 2.1 time: 0.155679 Aug 09 18:31:45.820497 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 526/1076] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:45 2022] GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:31:46.842761 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-4ba20f3a-7db8-499a-84e8-3f1443d5b0bf tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:46.843489 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-4ba20f3a-7db8-499a-84e8-3f1443d5b0bf tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:46.850100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4ba20f3a-7db8-499a-84e8-3f1443d5b0bf tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:46.850578 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4ba20f3a-7db8-499a-84e8-3f1443d5b0bf tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:46.851036 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4ba20f3a-7db8-499a-84e8-3f1443d5b0bf tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:46.851726 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4ba20f3a-7db8-499a-84e8-3f1443d5b0bf tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:46.852180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4ba20f3a-7db8-499a-84e8-3f1443d5b0bf tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:46.852602 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4ba20f3a-7db8-499a-84e8-3f1443d5b0bf tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:46.985443 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4ba20f3a-7db8-499a-84e8-3f1443d5b0bf tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:46.992838 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-4ba20f3a-7db8-499a-84e8-3f1443d5b0bf tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4" status: 200 len: 1682 microversion: 2.1 time: 0.154385 Aug 09 18:31:46.993402 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 551/1077] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:46 2022] GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:31:48.015817 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-fbdcde50-afc6-4456-af8d-58efdd7a48a0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:48.016529 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-fbdcde50-afc6-4456-af8d-58efdd7a48a0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:48.022843 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fbdcde50-afc6-4456-af8d-58efdd7a48a0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:48.023327 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fbdcde50-afc6-4456-af8d-58efdd7a48a0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:48.023760 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fbdcde50-afc6-4456-af8d-58efdd7a48a0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:48.024450 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fbdcde50-afc6-4456-af8d-58efdd7a48a0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:48.024900 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fbdcde50-afc6-4456-af8d-58efdd7a48a0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:48.025897 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fbdcde50-afc6-4456-af8d-58efdd7a48a0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:48.170022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-fbdcde50-afc6-4456-af8d-58efdd7a48a0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:48.178715 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-fbdcde50-afc6-4456-af8d-58efdd7a48a0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4" status: 200 len: 1682 microversion: 2.1 time: 0.166694 Aug 09 18:31:48.183275 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 527/1078] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:48 2022] GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:31:48.548176 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-a4969793-bd1b-44ba-9f75-b4a0c4799d07 req-ed296eec-2be7-4a1f-8538-58ff39ebe941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db129123-67b6-4f98-b981-85ae85ddffb4", "name": "network-vif-deleted", "tag": "7ec7c092-3683-4177-9937-753b28d73027"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:31:48.558934 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-a4969793-bd1b-44ba-9f75-b4a0c4799d07 req-ed296eec-2be7-4a1f-8538-58ff39ebe941 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:48.559414 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-a4969793-bd1b-44ba-9f75-b4a0c4799d07 req-ed296eec-2be7-4a1f-8538-58ff39ebe941 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:48.559845 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-a4969793-bd1b-44ba-9f75-b4a0c4799d07 req-ed296eec-2be7-4a1f-8538-58ff39ebe941 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:48.573020 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-a4969793-bd1b-44ba-9f75-b4a0c4799d07 req-ed296eec-2be7-4a1f-8538-58ff39ebe941 service nova] Creating event network-vif-deleted:7ec7c092-3683-4177-9937-753b28d73027 for instance db129123-67b6-4f98-b981-85ae85ddffb4 on hv-cinder-79797 Aug 09 18:31:48.578657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-a4969793-bd1b-44ba-9f75-b4a0c4799d07 req-ed296eec-2be7-4a1f-8538-58ff39ebe941 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096994 Aug 09 18:31:48.582337 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 552/1079] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:31:49.201586 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-06c065cb-d53d-43f2-9fed-630c39eefbbe tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:49.202285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-06c065cb-d53d-43f2-9fed-630c39eefbbe tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:49.209057 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-06c065cb-d53d-43f2-9fed-630c39eefbbe tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:49.209533 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-06c065cb-d53d-43f2-9fed-630c39eefbbe tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:49.209964 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-06c065cb-d53d-43f2-9fed-630c39eefbbe tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:49.210678 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-06c065cb-d53d-43f2-9fed-630c39eefbbe tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:49.211260 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-06c065cb-d53d-43f2-9fed-630c39eefbbe tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:49.211678 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-06c065cb-d53d-43f2-9fed-630c39eefbbe tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:49.243295 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-06c065cb-d53d-43f2-9fed-630c39eefbbe tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:49.243781 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-06c065cb-d53d-43f2-9fed-630c39eefbbe tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:49.244900 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-06c065cb-d53d-43f2-9fed-630c39eefbbe tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:49.245404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.objects.instance [None req-06c065cb-d53d-43f2-9fed-630c39eefbbe tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lazy-loading 'fault' on Instance uuid db129123-67b6-4f98-b981-85ae85ddffb4 {{(pid=118314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:31:49.290144 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-06c065cb-d53d-43f2-9fed-630c39eefbbe tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:49.299197 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-06c065cb-d53d-43f2-9fed-630c39eefbbe tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4" status: 200 len: 1332 microversion: 2.1 time: 0.102563 Aug 09 18:31:49.299861 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 528/1080] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:49 2022] GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4 => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:31:50.372851 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9f21f119-3bf9-47db-a7b5-608e2bfd04f3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:50.373551 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-9f21f119-3bf9-47db-a7b5-608e2bfd04f3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:50.379669 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9f21f119-3bf9-47db-a7b5-608e2bfd04f3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:50.380153 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9f21f119-3bf9-47db-a7b5-608e2bfd04f3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:50.380595 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9f21f119-3bf9-47db-a7b5-608e2bfd04f3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:50.381282 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9f21f119-3bf9-47db-a7b5-608e2bfd04f3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:50.381736 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9f21f119-3bf9-47db-a7b5-608e2bfd04f3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:50.382159 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-9f21f119-3bf9-47db-a7b5-608e2bfd04f3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:50.395641 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-9f21f119-3bf9-47db-a7b5-608e2bfd04f3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] HTTP exception thrown: Instance db129123-67b6-4f98-b981-85ae85ddffb4 could not be found. Aug 09 18:31:50.397313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9f21f119-3bf9-47db-a7b5-608e2bfd04f3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Request method failure captured: Aug 09 18:31:50.397313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4 HTTP/1.1 Aug 09 18:31:50.397313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:31:50.397313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:31:50.397313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:31:50.397313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:31:50.397313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:31:50.397313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:31:50.397313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:31:50.397313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:31:50.397313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qbq-DOR3BxtGwkou5FwWz3xCIphiCip_GcoqUJfS6TCAlx9byuBwIsmvUqfP7bc54bYmFRCJl-p5wNCqL_fYghaK74o19PAt7cT5_Jm9E5N7e6fbCSxsZ4jxot64kXs_bht-AoiM83Iuo9LFBE11D8xofJdBHQ3q85AlPLOazPfMOg Aug 09 18:31:50.397313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:31:50.397313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:31:50.397313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:31:50.397313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:31:50.397313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:31:50.397313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:31:50.397313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:31:50.397313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:31:50.397313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:31:50.397313 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:31:50.399906 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ef103f8a63404f918eaa5dd0c626b4c0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:31:50.399906 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:31:50.399906 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:31:50.399906 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:31:50.399906 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:31:50.399906 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:31:50.399906 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:31:50.399906 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: b5ffbaec36054aa3a89cca8b6007c8bb Aug 09 18:31:50.399906 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:31:50.399906 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:31:50.399906 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Instance db129123-67b6-4f98-b981-85ae85ddffb4 could not be found. Aug 09 18:31:50.399906 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': 'db129123-67b6-4f98-b981-85ae85ddffb4'} Aug 09 18:31:50.402085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:31:50.402085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:31:50.402085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:31:50.402085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:31:50.402085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:31:50.402085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:31:50.402085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:31:50.402085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:31:50.402085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:31:50.402085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:31:50.402085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db129123-67b6-4f98-b981-85ae85ddffb4 could not be found. Aug 09 18:31:50.402085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:31:50.402085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:31:50.402085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:31:50.402085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:31:50.402085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:31:50.402085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:31:50.402085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:31:50.402085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:31:50.402085 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:31:50.404946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:31:50.404946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:31:50.404946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:31:50.404946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:31:50.404946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:31:50.404946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:31:50.404946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:31:50.404946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db129123-67b6-4f98-b981-85ae85ddffb4 could not be found. Aug 09 18:31:50.404946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:31:50.404946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:31:50.404946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:31:50.404946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:31:50.404946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:31:50.404946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:31:50.404946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:31:50.404946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:31:50.404946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db129123-67b6-4f98-b981-85ae85ddffb4 could not be found. Aug 09 18:31:50.404946 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:31:50.407469 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-9f21f119-3bf9-47db-a7b5-608e2bfd04f3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Returning 404 to user: Instance db129123-67b6-4f98-b981-85ae85ddffb4 could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:31:50.407469 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-9f21f119-3bf9-47db-a7b5-608e2bfd04f3 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4" status: 404 len: 111 microversion: 2.1 time: 0.081252 Aug 09 18:31:50.407469 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 553/1081] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:50 2022] GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:31:50.410102 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c301cabe-756b-4c51-b2b7-e6f85fec16d6 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '.version_select at 0x7f4c351ccee0>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:50.506408 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c301cabe-756b-4c51-b2b7-e6f85fec16d6 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1885030371" status: 202 len: 0 microversion: 2.1 time: 0.101506 Aug 09 18:31:50.507206 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 529/1082] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Aug 9 18:31:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1885030371 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:31:51.267274 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2dc520cd-7c23-4454-aee7-b19bb375d1f1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Action: 'create', calling method: .version_select at 0x7f4c3540f8b0>, body: {"keypair": {"name": "tempest-keypair-329407113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLF1RhtVKZRfr6eOS80aaQHuNrD5PZPgaKnGFoebNuyM0KcmspqNpApBt+WOOD0p/oYVd5UzmjtsYkXyYJ2f9q+Keq8Gr/2cUu1RYwTTIVnMokcylWmrbbFLe8BLrKKrKQ=="}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:31:51.283013 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-2dc520cd-7c23-4454-aee7-b19bb375d1f1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Getting quotas for project ef103f8a63404f918eaa5dd0c626b4c0. Resources: {'key_pairs'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:31:51.286754 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-2dc520cd-7c23-4454-aee7-b19bb375d1f1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Getting quotas for user b5ffbaec36054aa3a89cca8b6007c8bb and project ef103f8a63404f918eaa5dd0c626b4c0. Resources: {'key_pairs'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:31:51.369280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-2dc520cd-7c23-4454-aee7-b19bb375d1f1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.105761 Aug 09 18:31:51.369876 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 554/1083] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Aug 9 18:31:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:31:53.705495 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-4a85842a-ef72-4c9e-bf22-1b354f0d3976 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-824195414", "imageRef": "53732c26-c942-4646-ac3f-8d9e11ab4d57", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b718d6b0-7ac1-48df-9d78-732c5ed8dfb4"}], "security_groups": [{"name": "tempest-securitygroup--26569552"}], "key_name": "tempest-keypair-329407113", "user_data": "}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:31:53.810552 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.network.neutron [None req-4a85842a-ef72-4c9e-bf22-1b354f0d3976 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] validate_networks() for [('b718d6b0-7ac1-48df-9d78-732c5ed8dfb4', None, None, None, None, None)] {{(pid=118314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:31:54.181978 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-4a85842a-ef72-4c9e-bf22-1b354f0d3976 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Flavor limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:31:54.182457 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-4a85842a-ef72-4c9e-bf22-1b354f0d3976 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Image limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:31:54.182970 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-4a85842a-ef72-4c9e-bf22-1b354f0d3976 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Flavor pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:31:54.183382 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-4a85842a-ef72-4c9e-bf22-1b354f0d3976 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Image pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:31:54.183794 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-4a85842a-ef72-4c9e-bf22-1b354f0d3976 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:31:54.192563 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4a85842a-ef72-4c9e-bf22-1b354f0d3976 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:54.193044 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4a85842a-ef72-4c9e-bf22-1b354f0d3976 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:54.193479 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4a85842a-ef72-4c9e-bf22-1b354f0d3976 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:54.194196 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4a85842a-ef72-4c9e-bf22-1b354f0d3976 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:54.194646 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4a85842a-ef72-4c9e-bf22-1b354f0d3976 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:54.195091 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-4a85842a-ef72-4c9e-bf22-1b354f0d3976 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:54.212001 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-4a85842a-ef72-4c9e-bf22-1b354f0d3976 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Getting quotas for project ef103f8a63404f918eaa5dd0c626b4c0. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:31:54.216041 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-4a85842a-ef72-4c9e-bf22-1b354f0d3976 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Getting quotas for user b5ffbaec36054aa3a89cca8b6007c8bb and project ef103f8a63404f918eaa5dd0c626b4c0. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:31:54.227040 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-4a85842a-ef72-4c9e-bf22-1b354f0d3976 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Going to run 1 instances... {{(pid=118314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:31:54.229590 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-4a85842a-ef72-4c9e-bf22-1b354f0d3976 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53732c26-c942-4646-ac3f-8d9e11ab4d57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:31:54.362731 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-4a85842a-ef72-4c9e-bf22-1b354f0d3976 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.662206 Aug 09 18:31:54.363378 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 530/1084] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Aug 9 18:31:53 2022] POST /compute/v2.1/servers => generated 400 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:31:54.375464 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-63124725-d3a6-4837-92ae-cfef99fe8531 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:54.380869 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-63124725-d3a6-4837-92ae-cfef99fe8531 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:54.430890 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-63124725-d3a6-4837-92ae-cfef99fe8531 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:54.439787 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-63124725-d3a6-4837-92ae-cfef99fe8531 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74" status: 200 len: 1240 microversion: 2.1 time: 0.068656 Aug 09 18:31:54.440522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 555/1085] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:54 2022] GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:31:55.462030 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-79a36d69-2bc6-44c3-b16f-a3a67f7de7e5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:55.462774 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-79a36d69-2bc6-44c3-b16f-a3a67f7de7e5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:55.469855 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79a36d69-2bc6-44c3-b16f-a3a67f7de7e5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:55.470331 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79a36d69-2bc6-44c3-b16f-a3a67f7de7e5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:55.470781 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79a36d69-2bc6-44c3-b16f-a3a67f7de7e5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:55.471468 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79a36d69-2bc6-44c3-b16f-a3a67f7de7e5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:55.471917 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79a36d69-2bc6-44c3-b16f-a3a67f7de7e5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:55.472336 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-79a36d69-2bc6-44c3-b16f-a3a67f7de7e5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:55.535629 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-79a36d69-2bc6-44c3-b16f-a3a67f7de7e5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:55.543939 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-79a36d69-2bc6-44c3-b16f-a3a67f7de7e5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74" status: 200 len: 1244 microversion: 2.1 time: 0.086506 Aug 09 18:31:55.544505 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 531/1086] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:55 2022] GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:31:56.564895 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c2d38e75-e81d-4cd5-be33-6dcd5428870f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:56.565566 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-c2d38e75-e81d-4cd5-be33-6dcd5428870f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:56.572311 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c2d38e75-e81d-4cd5-be33-6dcd5428870f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:56.572942 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c2d38e75-e81d-4cd5-be33-6dcd5428870f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:56.576245 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c2d38e75-e81d-4cd5-be33-6dcd5428870f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:56.576245 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c2d38e75-e81d-4cd5-be33-6dcd5428870f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:56.576245 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c2d38e75-e81d-4cd5-be33-6dcd5428870f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:56.576245 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c2d38e75-e81d-4cd5-be33-6dcd5428870f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:56.642919 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-c2d38e75-e81d-4cd5-be33-6dcd5428870f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:56.651291 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-c2d38e75-e81d-4cd5-be33-6dcd5428870f tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74" status: 200 len: 1298 microversion: 2.1 time: 0.090042 Aug 09 18:31:56.656680 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 556/1087] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:56 2022] GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74 => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:31:57.672237 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c86fb7b7-e0c3-4612-aaa3-5a21cfc26918 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:57.672904 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c86fb7b7-e0c3-4612-aaa3-5a21cfc26918 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:57.679929 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c86fb7b7-e0c3-4612-aaa3-5a21cfc26918 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:57.679929 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c86fb7b7-e0c3-4612-aaa3-5a21cfc26918 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:57.680178 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c86fb7b7-e0c3-4612-aaa3-5a21cfc26918 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:57.681347 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c86fb7b7-e0c3-4612-aaa3-5a21cfc26918 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:57.681347 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c86fb7b7-e0c3-4612-aaa3-5a21cfc26918 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:57.681823 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c86fb7b7-e0c3-4612-aaa3-5a21cfc26918 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:57.885970 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c86fb7b7-e0c3-4612-aaa3-5a21cfc26918 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:57.893445 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c86fb7b7-e0c3-4612-aaa3-5a21cfc26918 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74" status: 200 len: 1364 microversion: 2.1 time: 0.225065 Aug 09 18:31:57.894003 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 532/1088] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:57 2022] GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74 => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:31:57.978901 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-e5abecd0-54ca-44e2-89fb-b81cdf7c74d9 req-4c654ffa-fe1e-4623-9b84-8fd418f87621 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9ad663-b4d8-4426-a4f6-10e822acda74", "tag": "0c34ecf0-9de6-4509-9ec6-ed8387f5ab5b"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:31:57.990025 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-e5abecd0-54ca-44e2-89fb-b81cdf7c74d9 req-4c654ffa-fe1e-4623-9b84-8fd418f87621 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:57.990502 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-e5abecd0-54ca-44e2-89fb-b81cdf7c74d9 req-4c654ffa-fe1e-4623-9b84-8fd418f87621 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:57.990954 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-e5abecd0-54ca-44e2-89fb-b81cdf7c74d9 req-4c654ffa-fe1e-4623-9b84-8fd418f87621 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:58.002047 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-e5abecd0-54ca-44e2-89fb-b81cdf7c74d9 req-4c654ffa-fe1e-4623-9b84-8fd418f87621 service nova] Creating event network-changed:0c34ecf0-9de6-4509-9ec6-ed8387f5ab5b for instance bf9ad663-b4d8-4426-a4f6-10e822acda74 on hv-cinder-79797 Aug 09 18:31:58.007016 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-e5abecd0-54ca-44e2-89fb-b81cdf7c74d9 req-4c654ffa-fe1e-4623-9b84-8fd418f87621 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032023 Aug 09 18:31:58.007769 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 557/1089] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:31:58.914666 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-6f37d946-9465-405a-b516-909425821c30 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:58.915252 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-6f37d946-9465-405a-b516-909425821c30 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:58.922513 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6f37d946-9465-405a-b516-909425821c30 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:58.923022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6f37d946-9465-405a-b516-909425821c30 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:58.923453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6f37d946-9465-405a-b516-909425821c30 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:58.924135 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6f37d946-9465-405a-b516-909425821c30 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:58.924588 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6f37d946-9465-405a-b516-909425821c30 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:58.925005 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-6f37d946-9465-405a-b516-909425821c30 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:59.055417 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-6f37d946-9465-405a-b516-909425821c30 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:59.062789 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-6f37d946-9465-405a-b516-909425821c30 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74" status: 200 len: 1364 microversion: 2.1 time: 0.152092 Aug 09 18:31:59.063359 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 533/1090] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:58 2022] GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:32:00.084620 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-61916668-40b8-4e94-8906-9b7bd74b0b9a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:32:00.085262 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-61916668-40b8-4e94-8906-9b7bd74b0b9a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:32:00.091927 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-61916668-40b8-4e94-8906-9b7bd74b0b9a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:00.092405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-61916668-40b8-4e94-8906-9b7bd74b0b9a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:00.092840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-61916668-40b8-4e94-8906-9b7bd74b0b9a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:00.093520 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-61916668-40b8-4e94-8906-9b7bd74b0b9a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:00.094067 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-61916668-40b8-4e94-8906-9b7bd74b0b9a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:00.094485 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-61916668-40b8-4e94-8906-9b7bd74b0b9a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:00.225032 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-61916668-40b8-4e94-8906-9b7bd74b0b9a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:32:00.233138 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-61916668-40b8-4e94-8906-9b7bd74b0b9a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74" status: 200 len: 1364 microversion: 2.1 time: 0.152769 Aug 09 18:32:00.233718 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 558/1091] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:32:00 2022] GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:32:01.253938 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-9adeb978-e7e3-4eec-89c0-ad076cb9bd65 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:32:01.254986 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-9adeb978-e7e3-4eec-89c0-ad076cb9bd65 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:32:01.261124 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9adeb978-e7e3-4eec-89c0-ad076cb9bd65 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:01.261976 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9adeb978-e7e3-4eec-89c0-ad076cb9bd65 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:01.262441 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9adeb978-e7e3-4eec-89c0-ad076cb9bd65 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:01.263125 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9adeb978-e7e3-4eec-89c0-ad076cb9bd65 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:01.263575 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9adeb978-e7e3-4eec-89c0-ad076cb9bd65 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:01.263997 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9adeb978-e7e3-4eec-89c0-ad076cb9bd65 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:01.395560 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-9adeb978-e7e3-4eec-89c0-ad076cb9bd65 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:32:01.403030 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-9adeb978-e7e3-4eec-89c0-ad076cb9bd65 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74" status: 200 len: 1364 microversion: 2.1 time: 0.152933 Aug 09 18:32:01.403979 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 534/1092] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:32:01 2022] GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:32:02.423533 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2d6d39d3-8b7d-4b34-98da-a4b7e907b058 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:32:02.424238 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-2d6d39d3-8b7d-4b34-98da-a4b7e907b058 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:32:02.430647 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2d6d39d3-8b7d-4b34-98da-a4b7e907b058 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:02.431162 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2d6d39d3-8b7d-4b34-98da-a4b7e907b058 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:02.431600 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2d6d39d3-8b7d-4b34-98da-a4b7e907b058 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:02.432828 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2d6d39d3-8b7d-4b34-98da-a4b7e907b058 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:02.433464 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2d6d39d3-8b7d-4b34-98da-a4b7e907b058 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:02.433899 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2d6d39d3-8b7d-4b34-98da-a4b7e907b058 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:02.562611 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-2d6d39d3-8b7d-4b34-98da-a4b7e907b058 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:32:02.569987 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-2d6d39d3-8b7d-4b34-98da-a4b7e907b058 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74" status: 200 len: 1364 microversion: 2.1 time: 0.150265 Aug 09 18:32:02.570553 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 559/1093] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:32:02 2022] GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:32:03.591972 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f5ff32ab-2c43-49ef-be5c-6bfe0fec27d7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:32:03.592577 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f5ff32ab-2c43-49ef-be5c-6bfe0fec27d7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:32:03.599448 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f5ff32ab-2c43-49ef-be5c-6bfe0fec27d7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:03.599946 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f5ff32ab-2c43-49ef-be5c-6bfe0fec27d7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:03.600498 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f5ff32ab-2c43-49ef-be5c-6bfe0fec27d7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:03.601198 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f5ff32ab-2c43-49ef-be5c-6bfe0fec27d7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:03.601652 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f5ff32ab-2c43-49ef-be5c-6bfe0fec27d7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:03.602076 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f5ff32ab-2c43-49ef-be5c-6bfe0fec27d7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:03.732486 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f5ff32ab-2c43-49ef-be5c-6bfe0fec27d7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:32:03.739931 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f5ff32ab-2c43-49ef-be5c-6bfe0fec27d7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74" status: 200 len: 1364 microversion: 2.1 time: 0.152406 Aug 09 18:32:03.740499 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 535/1094] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:32:03 2022] GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:32:04.760190 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-ce45e38f-3ced-4d7f-b78d-56b3f0dc2040 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:32:04.760805 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-ce45e38f-3ced-4d7f-b78d-56b3f0dc2040 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:32:04.763454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=6 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:32:04.764131 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:32:04.768836 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ce45e38f-3ced-4d7f-b78d-56b3f0dc2040 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:04.769329 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ce45e38f-3ced-4d7f-b78d-56b3f0dc2040 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:04.769768 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ce45e38f-3ced-4d7f-b78d-56b3f0dc2040 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:04.770479 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ce45e38f-3ced-4d7f-b78d-56b3f0dc2040 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:04.770972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ce45e38f-3ced-4d7f-b78d-56b3f0dc2040 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:04.771397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ce45e38f-3ced-4d7f-b78d-56b3f0dc2040 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:04.775596 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:32:04.892942 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-b5ba4c73-f522-47b3-a010-a72ac2276724 req-3867e045-e88f-4c5e-8224-4c50685d71e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9ad663-b4d8-4426-a4f6-10e822acda74", "name": "network-vif-plugged", "status": "completed", "tag": "0c34ecf0-9de6-4509-9ec6-ed8387f5ab5b"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:32:04.899206 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=2 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:32:04.899887 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=6 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:32:04.906726 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-b5ba4c73-f522-47b3-a010-a72ac2276724 req-3867e045-e88f-4c5e-8224-4c50685d71e6 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:04.907239 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-b5ba4c73-f522-47b3-a010-a72ac2276724 req-3867e045-e88f-4c5e-8224-4c50685d71e6 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:04.907822 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-b5ba4c73-f522-47b3-a010-a72ac2276724 req-3867e045-e88f-4c5e-8224-4c50685d71e6 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:04.911410 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-ce45e38f-3ced-4d7f-b78d-56b3f0dc2040 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:32:04.919775 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-ce45e38f-3ced-4d7f-b78d-56b3f0dc2040 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74" status: 200 len: 1364 microversion: 2.1 time: 0.163425 Aug 09 18:32:04.920341 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-b5ba4c73-f522-47b3-a010-a72ac2276724 req-3867e045-e88f-4c5e-8224-4c50685d71e6 service nova] Creating event network-vif-plugged:0c34ecf0-9de6-4509-9ec6-ed8387f5ab5b for instance bf9ad663-b4d8-4426-a4f6-10e822acda74 on hv-cinder-79797 Aug 09 18:32:04.920480 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 560/1095] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:32:04 2022] GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:32:04.926320 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-b5ba4c73-f522-47b3-a010-a72ac2276724 req-3867e045-e88f-4c5e-8224-4c50685d71e6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037083 Aug 09 18:32:04.926925 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 536/1096] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:32:05.940602 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e01eb7b9-ae19-4816-8a6b-291ac386c6ed tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:32:05.941244 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e01eb7b9-ae19-4816-8a6b-291ac386c6ed tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:32:05.948668 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e01eb7b9-ae19-4816-8a6b-291ac386c6ed tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:05.949288 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e01eb7b9-ae19-4816-8a6b-291ac386c6ed tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:05.949829 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e01eb7b9-ae19-4816-8a6b-291ac386c6ed tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:05.950522 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e01eb7b9-ae19-4816-8a6b-291ac386c6ed tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:05.951004 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e01eb7b9-ae19-4816-8a6b-291ac386c6ed tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:05.951517 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e01eb7b9-ae19-4816-8a6b-291ac386c6ed tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:06.083624 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e01eb7b9-ae19-4816-8a6b-291ac386c6ed tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:32:06.091779 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e01eb7b9-ae19-4816-8a6b-291ac386c6ed tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74" status: 200 len: 1364 microversion: 2.1 time: 0.155287 Aug 09 18:32:06.092353 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 561/1097] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:32:05 2022] GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:32:07.114040 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d32040cc-cfe7-4a5c-9f65-114f96530d82 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:32:07.114753 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d32040cc-cfe7-4a5c-9f65-114f96530d82 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:32:07.122342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d32040cc-cfe7-4a5c-9f65-114f96530d82 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:07.122920 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d32040cc-cfe7-4a5c-9f65-114f96530d82 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:07.123375 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d32040cc-cfe7-4a5c-9f65-114f96530d82 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:07.124129 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d32040cc-cfe7-4a5c-9f65-114f96530d82 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:07.124578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d32040cc-cfe7-4a5c-9f65-114f96530d82 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:07.125057 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d32040cc-cfe7-4a5c-9f65-114f96530d82 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:07.262928 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d32040cc-cfe7-4a5c-9f65-114f96530d82 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:32:07.270305 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d32040cc-cfe7-4a5c-9f65-114f96530d82 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74" status: 200 len: 1554 microversion: 2.1 time: 0.161464 Aug 09 18:32:07.270908 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 537/1098] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:32:07 2022] GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:32:07.291098 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5c3b8d89-d24d-444e-8e73-d860cbbf2cd8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:32:07.291625 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-5c3b8d89-d24d-444e-8e73-d860cbbf2cd8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:32:07.298063 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5c3b8d89-d24d-444e-8e73-d860cbbf2cd8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:07.298545 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5c3b8d89-d24d-444e-8e73-d860cbbf2cd8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:07.299020 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5c3b8d89-d24d-444e-8e73-d860cbbf2cd8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:07.299709 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5c3b8d89-d24d-444e-8e73-d860cbbf2cd8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:07.300164 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5c3b8d89-d24d-444e-8e73-d860cbbf2cd8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:07.300588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5c3b8d89-d24d-444e-8e73-d860cbbf2cd8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:07.376191 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-5c3b8d89-d24d-444e-8e73-d860cbbf2cd8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088813 Aug 09 18:32:07.376789 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 562/1099] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Aug 9 18:32:07 2022] GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:32:08.389219 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-22e22d66-0f04-4079-8bd4-df3c7fb0d4fa req-12f837bb-4379-40e2-ab98-8a941a6885f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9ad663-b4d8-4426-a4f6-10e822acda74", "tag": "0c34ecf0-9de6-4509-9ec6-ed8387f5ab5b"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:32:08.399100 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-22e22d66-0f04-4079-8bd4-df3c7fb0d4fa req-12f837bb-4379-40e2-ab98-8a941a6885f5 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:08.399581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-22e22d66-0f04-4079-8bd4-df3c7fb0d4fa req-12f837bb-4379-40e2-ab98-8a941a6885f5 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:08.400021 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-22e22d66-0f04-4079-8bd4-df3c7fb0d4fa req-12f837bb-4379-40e2-ab98-8a941a6885f5 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:08.411222 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-22e22d66-0f04-4079-8bd4-df3c7fb0d4fa req-12f837bb-4379-40e2-ab98-8a941a6885f5 service nova] Creating event network-changed:0c34ecf0-9de6-4509-9ec6-ed8387f5ab5b for instance bf9ad663-b4d8-4426-a4f6-10e822acda74 on hv-cinder-79797 Aug 09 18:32:08.416044 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-22e22d66-0f04-4079-8bd4-df3c7fb0d4fa req-12f837bb-4379-40e2-ab98-8a941a6885f5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031621 Aug 09 18:32:08.416819 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 538/1100] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:33:14.815766 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=5 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:33:14.822959 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=15 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:33:14.822959 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-edd464e2-5655-4aef-84c0-e546372770b8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:14.822959 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-edd464e2-5655-4aef-84c0-e546372770b8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:14.827502 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-edd464e2-5655-4aef-84c0-e546372770b8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:14.827987 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-edd464e2-5655-4aef-84c0-e546372770b8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:14.828424 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-edd464e2-5655-4aef-84c0-e546372770b8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:14.829111 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-edd464e2-5655-4aef-84c0-e546372770b8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:14.829568 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-edd464e2-5655-4aef-84c0-e546372770b8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:14.829992 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-edd464e2-5655-4aef-84c0-e546372770b8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:14.853352 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-edd464e2-5655-4aef-84c0-e546372770b8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74/ips" status: 200 len: 149 microversion: 2.1 time: 0.039448 Aug 09 18:33:14.854367 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 563/1101] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Aug 9 18:33:14 2022] GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:33:16.465616 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:33:16.471938 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=84 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:33:16.471938 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-56de03a7-087b-49e4-983e-64de5d7fd5a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a538b13-e4ca-498e-9fde-30360fa2bbf4"}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:33:16.473641 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-56de03a7-087b-49e4-983e-64de5d7fd5a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:16.479661 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-56de03a7-087b-49e4-983e-64de5d7fd5a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:16.480143 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-56de03a7-087b-49e4-983e-64de5d7fd5a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:16.480837 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-56de03a7-087b-49e4-983e-64de5d7fd5a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:16.481752 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-56de03a7-087b-49e4-983e-64de5d7fd5a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:16.482954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-56de03a7-087b-49e4-983e-64de5d7fd5a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:16.482954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-56de03a7-087b-49e4-983e-64de5d7fd5a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:17.186335 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-56de03a7-087b-49e4-983e-64de5d7fd5a5 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "POST /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.722408 Aug 09 18:33:17.187014 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 539/1102] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Aug 9 18:33:16 2022] POST /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74/os-volume_attachments => generated 194 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:33:24.813469 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-87c038f1-2a06-4e62-baf3-3dd564d2086e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:24.816130 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-87c038f1-2a06-4e62-baf3-3dd564d2086e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:24.820778 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-87c038f1-2a06-4e62-baf3-3dd564d2086e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:24.821255 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-87c038f1-2a06-4e62-baf3-3dd564d2086e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:24.821689 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-87c038f1-2a06-4e62-baf3-3dd564d2086e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:24.822366 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-87c038f1-2a06-4e62-baf3-3dd564d2086e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:24.822847 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-87c038f1-2a06-4e62-baf3-3dd564d2086e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:24.823267 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-87c038f1-2a06-4e62-baf3-3dd564d2086e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:24.904665 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.objects.instance [None req-87c038f1-2a06-4e62-baf3-3dd564d2086e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lazy-loading 'services' on Instance uuid bf9ad663-b4d8-4426-a4f6-10e822acda74 {{(pid=118313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:33:25.147895 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-87c038f1-2a06-4e62-baf3-3dd564d2086e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74/os-volume_attachments/5a538b13-e4ca-498e-9fde-30360fa2bbf4" status: 202 len: 0 microversion: 2.1 time: 0.339571 Aug 09 18:33:25.148488 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 564/1103] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Aug 9 18:33:24 2022] DELETE /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74/os-volume_attachments/5a538b13-e4ca-498e-9fde-30360fa2bbf4 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:33:25.158262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d8479ff3-cd6f-4ee6-a76c-9ab5a66bd5c7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:25.160713 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d8479ff3-cd6f-4ee6-a76c-9ab5a66bd5c7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:25.166911 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d8479ff3-cd6f-4ee6-a76c-9ab5a66bd5c7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:25.167393 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d8479ff3-cd6f-4ee6-a76c-9ab5a66bd5c7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:25.167829 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d8479ff3-cd6f-4ee6-a76c-9ab5a66bd5c7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:25.168523 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d8479ff3-cd6f-4ee6-a76c-9ab5a66bd5c7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:25.168979 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d8479ff3-cd6f-4ee6-a76c-9ab5a66bd5c7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:25.169405 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d8479ff3-cd6f-4ee6-a76c-9ab5a66bd5c7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:25.199477 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d8479ff3-cd6f-4ee6-a76c-9ab5a66bd5c7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046492 Aug 09 18:33:25.200033 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 540/1104] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Aug 9 18:33:25 2022] GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:33:26.213480 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a9ded2cd-bf92-4b52-bb4c-3ab3db2903a9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:26.215845 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a9ded2cd-bf92-4b52-bb4c-3ab3db2903a9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:26.222322 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a9ded2cd-bf92-4b52-bb4c-3ab3db2903a9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:26.222865 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a9ded2cd-bf92-4b52-bb4c-3ab3db2903a9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:26.223285 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a9ded2cd-bf92-4b52-bb4c-3ab3db2903a9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:26.223971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a9ded2cd-bf92-4b52-bb4c-3ab3db2903a9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:26.224426 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a9ded2cd-bf92-4b52-bb4c-3ab3db2903a9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:26.224849 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a9ded2cd-bf92-4b52-bb4c-3ab3db2903a9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:26.253525 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a9ded2cd-bf92-4b52-bb4c-3ab3db2903a9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044827 Aug 09 18:33:26.254000 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 565/1105] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Aug 9 18:33:26 2022] GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 18:33:26.315246 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-82603153-75ef-4c5f-acb6-728e46022c23 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:26.315776 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-82603153-75ef-4c5f-acb6-728e46022c23 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:26.322004 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-82603153-75ef-4c5f-acb6-728e46022c23 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:26.322501 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-82603153-75ef-4c5f-acb6-728e46022c23 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:26.322952 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-82603153-75ef-4c5f-acb6-728e46022c23 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:26.323636 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-82603153-75ef-4c5f-acb6-728e46022c23 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:26.324088 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-82603153-75ef-4c5f-acb6-728e46022c23 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:26.324509 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-82603153-75ef-4c5f-acb6-728e46022c23 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:26.349595 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-82603153-75ef-4c5f-acb6-728e46022c23 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Going to try to terminate instance {{(pid=118314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:33:26.673923 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-82603153-75ef-4c5f-acb6-728e46022c23 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74" status: 204 len: 0 microversion: 2.1 time: 0.362632 Aug 09 18:33:26.674429 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 541/1106] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:33:26 2022] DELETE /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:33:26.682977 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-26b50903-00a7-4f4c-ac32-ee1afbe8ae2e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:26.683670 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-26b50903-00a7-4f4c-ac32-ee1afbe8ae2e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:26.691193 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-26b50903-00a7-4f4c-ac32-ee1afbe8ae2e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:26.691666 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-26b50903-00a7-4f4c-ac32-ee1afbe8ae2e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:26.692096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-26b50903-00a7-4f4c-ac32-ee1afbe8ae2e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:26.692829 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-26b50903-00a7-4f4c-ac32-ee1afbe8ae2e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:26.693279 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-26b50903-00a7-4f4c-ac32-ee1afbe8ae2e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:26.693697 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-26b50903-00a7-4f4c-ac32-ee1afbe8ae2e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:26.828569 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-26b50903-00a7-4f4c-ac32-ee1afbe8ae2e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:33:26.836101 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-26b50903-00a7-4f4c-ac32-ee1afbe8ae2e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74" status: 200 len: 1678 microversion: 2.1 time: 0.157148 Aug 09 18:33:26.836658 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 566/1107] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:26 2022] GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:33:27.858022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-64ad4674-be02-42a3-a5b8-1c29fc5c47fc tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:27.859971 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-64ad4674-be02-42a3-a5b8-1c29fc5c47fc tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:27.865243 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-64ad4674-be02-42a3-a5b8-1c29fc5c47fc tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:27.865777 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-64ad4674-be02-42a3-a5b8-1c29fc5c47fc tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:27.866201 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-64ad4674-be02-42a3-a5b8-1c29fc5c47fc tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:27.867040 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-64ad4674-be02-42a3-a5b8-1c29fc5c47fc tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:27.867502 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-64ad4674-be02-42a3-a5b8-1c29fc5c47fc tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:27.867930 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-64ad4674-be02-42a3-a5b8-1c29fc5c47fc tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:27.999724 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-64ad4674-be02-42a3-a5b8-1c29fc5c47fc tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:33:28.007306 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-64ad4674-be02-42a3-a5b8-1c29fc5c47fc tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74" status: 200 len: 1678 microversion: 2.1 time: 0.153544 Aug 09 18:33:28.007907 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 542/1108] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:27 2022] GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:33:29.029078 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-69be5b83-62ef-42c0-a6a9-f02ae8659b17 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:29.030404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-69be5b83-62ef-42c0-a6a9-f02ae8659b17 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:29.036900 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-69be5b83-62ef-42c0-a6a9-f02ae8659b17 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:29.038576 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-69be5b83-62ef-42c0-a6a9-f02ae8659b17 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:29.038576 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-69be5b83-62ef-42c0-a6a9-f02ae8659b17 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:29.038576 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-69be5b83-62ef-42c0-a6a9-f02ae8659b17 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:29.038942 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-69be5b83-62ef-42c0-a6a9-f02ae8659b17 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:29.039372 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-69be5b83-62ef-42c0-a6a9-f02ae8659b17 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:29.225429 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-69be5b83-62ef-42c0-a6a9-f02ae8659b17 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:33:29.234887 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-69be5b83-62ef-42c0-a6a9-f02ae8659b17 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74" status: 200 len: 1678 microversion: 2.1 time: 0.209496 Aug 09 18:33:29.236048 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 567/1109] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:29 2022] GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74 => generated 1678 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:33:29.510619 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-1f0ecf9d-fd15-4c10-a56a-3268c21b52cf req-1cb9dbfb-d9d3-4206-b446-50d7f4a97454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9ad663-b4d8-4426-a4f6-10e822acda74", "name": "network-vif-deleted", "tag": "0c34ecf0-9de6-4509-9ec6-ed8387f5ab5b"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:33:29.522502 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-1f0ecf9d-fd15-4c10-a56a-3268c21b52cf req-1cb9dbfb-d9d3-4206-b446-50d7f4a97454 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:29.523160 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-1f0ecf9d-fd15-4c10-a56a-3268c21b52cf req-1cb9dbfb-d9d3-4206-b446-50d7f4a97454 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:29.523712 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-1f0ecf9d-fd15-4c10-a56a-3268c21b52cf req-1cb9dbfb-d9d3-4206-b446-50d7f4a97454 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:29.534847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-1f0ecf9d-fd15-4c10-a56a-3268c21b52cf req-1cb9dbfb-d9d3-4206-b446-50d7f4a97454 service nova] Creating event network-vif-deleted:0c34ecf0-9de6-4509-9ec6-ed8387f5ab5b for instance bf9ad663-b4d8-4426-a4f6-10e822acda74 on hv-cinder-79797 Aug 09 18:33:29.539702 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-1f0ecf9d-fd15-4c10-a56a-3268c21b52cf req-1cb9dbfb-d9d3-4206-b446-50d7f4a97454 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032873 Aug 09 18:33:29.540633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 543/1110] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:33:30.256715 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-123274fa-344a-4190-89d0-bf3f08eb0704 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:30.257333 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-123274fa-344a-4190-89d0-bf3f08eb0704 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:30.265211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-123274fa-344a-4190-89d0-bf3f08eb0704 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:30.265711 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-123274fa-344a-4190-89d0-bf3f08eb0704 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:30.266151 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-123274fa-344a-4190-89d0-bf3f08eb0704 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:30.267163 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-123274fa-344a-4190-89d0-bf3f08eb0704 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:30.267854 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-123274fa-344a-4190-89d0-bf3f08eb0704 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:30.268506 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-123274fa-344a-4190-89d0-bf3f08eb0704 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:30.302989 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-123274fa-344a-4190-89d0-bf3f08eb0704 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:30.303476 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-123274fa-344a-4190-89d0-bf3f08eb0704 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:30.303910 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-123274fa-344a-4190-89d0-bf3f08eb0704 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:30.304367 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.objects.instance [None req-123274fa-344a-4190-89d0-bf3f08eb0704 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lazy-loading 'fault' on Instance uuid bf9ad663-b4d8-4426-a4f6-10e822acda74 {{(pid=118313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:33:30.347797 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-123274fa-344a-4190-89d0-bf3f08eb0704 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ffbaec36054aa3a89cca8b6007c8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef103f8a63404f918eaa5dd0c626b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:33:30.355799 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-123274fa-344a-4190-89d0-bf3f08eb0704 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74" status: 200 len: 1330 microversion: 2.1 time: 0.102707 Aug 09 18:33:30.356055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 568/1111] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:30 2022] GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74 => generated 1330 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:33:31.384496 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-9e2022e1-491b-4bfd-9eed-80a10e11c5d0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:31.385220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-9e2022e1-491b-4bfd-9eed-80a10e11c5d0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:31.391715 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9e2022e1-491b-4bfd-9eed-80a10e11c5d0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:31.392187 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9e2022e1-491b-4bfd-9eed-80a10e11c5d0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:31.392616 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9e2022e1-491b-4bfd-9eed-80a10e11c5d0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:31.393294 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9e2022e1-491b-4bfd-9eed-80a10e11c5d0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:31.393739 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9e2022e1-491b-4bfd-9eed-80a10e11c5d0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:31.394158 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9e2022e1-491b-4bfd-9eed-80a10e11c5d0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:31.407100 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-9e2022e1-491b-4bfd-9eed-80a10e11c5d0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] HTTP exception thrown: Instance bf9ad663-b4d8-4426-a4f6-10e822acda74 could not be found. Aug 09 18:33:31.408747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-9e2022e1-491b-4bfd-9eed-80a10e11c5d0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Request method failure captured: Aug 09 18:33:31.408747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74 HTTP/1.1 Aug 09 18:33:31.408747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:33:31.408747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:33:31.408747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:33:31.408747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 0 Aug 09 18:33:31.408747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:33:31.408747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:33:31.408747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:33:31.408747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:33:31.408747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qbq-DOR3BxtGwkou5FwWz3xCIphiCip_GcoqUJfS6TCAlx9byuBwIsmvUqfP7bc54bYmFRCJl-p5wNCqL_fYghaK74o19PAt7cT5_Jm9E5N7e6fbCSxsZ4jxot64kXs_bht-AoiM83Iuo9LFBE11D8xofJdBHQ3q85AlPLOazPfMOg Aug 09 18:33:31.408747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:33:31.408747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:33:31.408747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:33:31.408747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:33:31.408747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:33:31.408747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:33:31.408747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:33:31.408747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:31.408747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:33:31.408747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:33:31.410391 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ef103f8a63404f918eaa5dd0c626b4c0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:33:31.410391 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:31.410391 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:33:31.410391 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:31.410391 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:33:31.410391 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:33:31.410391 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:33:31.410391 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: b5ffbaec36054aa3a89cca8b6007c8bb Aug 09 18:33:31.410391 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:33:31.410391 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: > Aug 09 18:33:31.410391 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Instance bf9ad663-b4d8-4426-a4f6-10e822acda74 could not be found. Aug 09 18:33:31.410391 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'id': 'bf9ad663-b4d8-4426-a4f6-10e822acda74'} Aug 09 18:33:31.411276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:33:31.411276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:31.411276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:33:31.411276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:33:31.411276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:33:31.411276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:33:31.411276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:33:31.411276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:33:31.411276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:33:31.411276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:33:31.411276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf9ad663-b4d8-4426-a4f6-10e822acda74 could not be found. Aug 09 18:33:31.411276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:31.411276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:33:31.411276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:31.411276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:31.411276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:33:31.411276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:33:31.411276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:33:31.411276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:33:31.411276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:33:31.412710 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:33:31.412710 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:33:31.412710 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:33:31.412710 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:33:31.412710 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:33:31.412710 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:33:31.412710 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:33:31.412710 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf9ad663-b4d8-4426-a4f6-10e822acda74 could not be found. Aug 09 18:33:31.412710 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:31.412710 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:33:31.412710 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:31.412710 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:31.412710 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:33:31.412710 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:33:31.412710 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:33:31.412710 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:33:31.412710 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf9ad663-b4d8-4426-a4f6-10e822acda74 could not be found. Aug 09 18:33:31.412710 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:31.413955 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-9e2022e1-491b-4bfd-9eed-80a10e11c5d0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Returning 404 to user: Instance bf9ad663-b4d8-4426-a4f6-10e822acda74 could not be found. {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:33:31.413955 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-9e2022e1-491b-4bfd-9eed-80a10e11c5d0 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74" status: 404 len: 111 microversion: 2.1 time: 0.030289 Aug 09 18:33:31.413955 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 544/1112] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:31 2022] GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:33:31.418995 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-8f365631-5aeb-44e4-8ee2-7bb695f0d58a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '.version_select at 0x7f4c3540f8b0>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:31.481039 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-8f365631-5aeb-44e4-8ee2-7bb695f0d58a tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-329407113" status: 202 len: 0 microversion: 2.1 time: 0.065751 Aug 09 18:33:31.481625 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 569/1113] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Aug 9 18:33:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-329407113 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:33:33.504285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f3252c37-e0ce-4ff8-b9ff-d030e841f63e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:33.504807 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f3252c37-e0ce-4ff8-b9ff-d030e841f63e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:33.511098 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f3252c37-e0ce-4ff8-b9ff-d030e841f63e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:33.511579 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f3252c37-e0ce-4ff8-b9ff-d030e841f63e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:33.512013 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f3252c37-e0ce-4ff8-b9ff-d030e841f63e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:33.512727 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f3252c37-e0ce-4ff8-b9ff-d030e841f63e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:33.513179 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f3252c37-e0ce-4ff8-b9ff-d030e841f63e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:33.514104 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f3252c37-e0ce-4ff8-b9ff-d030e841f63e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:33.527154 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-f3252c37-e0ce-4ff8-b9ff-d030e841f63e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] HTTP exception thrown: Instance bf9ad663-b4d8-4426-a4f6-10e822acda74 could not be found. Aug 09 18:33:33.528676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f3252c37-e0ce-4ff8-b9ff-d030e841f63e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Request method failure captured: Aug 09 18:33:33.528676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: DELETE /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74 HTTP/1.1 Aug 09 18:33:33.528676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:33:33.528676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:33:33.528676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:33:33.528676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 0 Aug 09 18:33:33.528676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:33:33.528676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:33:33.528676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:33:33.528676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:33:33.528676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qbq-DOR3BxtGwkou5FwWz3xCIphiCip_GcoqUJfS6TCAlx9byuBwIsmvUqfP7bc54bYmFRCJl-p5wNCqL_fYghaK74o19PAt7cT5_Jm9E5N7e6fbCSxsZ4jxot64kXs_bht-AoiM83Iuo9LFBE11D8xofJdBHQ3q85AlPLOazPfMOg Aug 09 18:33:33.528676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:33:33.528676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:33:33.528676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:33:33.528676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:33:33.528676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:33:33.528676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:33:33.528676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:33:33.528676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:33.528676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:33:33.528676 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:33:33.531343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ef103f8a63404f918eaa5dd0c626b4c0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:33:33.531343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:33.531343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:33:33.531343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:33.531343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:33:33.531343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:33:33.531343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:33:33.531343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: b5ffbaec36054aa3a89cca8b6007c8bb Aug 09 18:33:33.531343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:33:33.531343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: > Aug 09 18:33:33.531343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Instance bf9ad663-b4d8-4426-a4f6-10e822acda74 could not be found. Aug 09 18:33:33.531343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'id': 'bf9ad663-b4d8-4426-a4f6-10e822acda74'} Aug 09 18:33:33.532403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:33:33.532403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:33.532403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:33:33.532403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:33:33.532403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:33:33.532403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:33:33.532403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:33:33.532403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:33:33.532403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:33:33.532403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:33:33.532403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf9ad663-b4d8-4426-a4f6-10e822acda74 could not be found. Aug 09 18:33:33.532403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:33.532403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:33:33.532403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:33.532403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:33.532403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:33:33.532403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:33:33.532403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:33:33.532403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:33:33.532403 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:33:33.533877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:33:33.533877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:33:33.533877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:33:33.533877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:33:33.533877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:33:33.533877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:33:33.533877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:33:33.533877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:33:33.533877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:33:33.533877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf9ad663-b4d8-4426-a4f6-10e822acda74 could not be found. Aug 09 18:33:33.533877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:33.533877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:33:33.533877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:33.533877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:33.533877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:33:33.533877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:33:33.533877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:33:33.533877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:33:33.533877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf9ad663-b4d8-4426-a4f6-10e822acda74 could not be found. Aug 09 18:33:33.533877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:33.535515 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f3252c37-e0ce-4ff8-b9ff-d030e841f63e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Returning 404 to user: Instance bf9ad663-b4d8-4426-a4f6-10e822acda74 could not be found. {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:33:33.535515 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f3252c37-e0ce-4ff8-b9ff-d030e841f63e tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74" status: 404 len: 111 microversion: 2.1 time: 0.030286 Aug 09 18:33:33.535515 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 545/1114] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:33:33 2022] DELETE /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:33:33.539498 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f0e7eab6-7493-4f9c-a18a-06059fa5e6b7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:33.540149 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f0e7eab6-7493-4f9c-a18a-06059fa5e6b7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: bf9ad663-b4d8-4426-a4f6-10e822acda74] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:33.548089 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f0e7eab6-7493-4f9c-a18a-06059fa5e6b7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:33.548575 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f0e7eab6-7493-4f9c-a18a-06059fa5e6b7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:33.549016 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f0e7eab6-7493-4f9c-a18a-06059fa5e6b7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:33.549705 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f0e7eab6-7493-4f9c-a18a-06059fa5e6b7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:33.550164 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f0e7eab6-7493-4f9c-a18a-06059fa5e6b7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:33.550589 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-f0e7eab6-7493-4f9c-a18a-06059fa5e6b7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:33.563757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-f0e7eab6-7493-4f9c-a18a-06059fa5e6b7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] HTTP exception thrown: Instance bf9ad663-b4d8-4426-a4f6-10e822acda74 could not be found. Aug 09 18:33:33.565398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f0e7eab6-7493-4f9c-a18a-06059fa5e6b7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Request method failure captured: Aug 09 18:33:33.565398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74 HTTP/1.1 Aug 09 18:33:33.565398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:33:33.565398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:33:33.565398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:33:33.565398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:33:33.565398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:33:33.565398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:33:33.565398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:33:33.565398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:33:33.565398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qbq-DOR3BxtGwkou5FwWz3xCIphiCip_GcoqUJfS6TCAlx9byuBwIsmvUqfP7bc54bYmFRCJl-p5wNCqL_fYghaK74o19PAt7cT5_Jm9E5N7e6fbCSxsZ4jxot64kXs_bht-AoiM83Iuo9LFBE11D8xofJdBHQ3q85AlPLOazPfMOg Aug 09 18:33:33.565398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:33:33.565398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:33:33.565398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:33:33.565398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:33:33.565398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:33:33.565398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:33:33.565398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:33:33.565398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:33.565398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:33:33.565398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:33:33.567115 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ef103f8a63404f918eaa5dd0c626b4c0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:33:33.567115 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:33.567115 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:33:33.567115 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:33.567115 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:33:33.567115 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:33:33.567115 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:33:33.567115 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: b5ffbaec36054aa3a89cca8b6007c8bb Aug 09 18:33:33.567115 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:33:33.567115 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:33:33.567115 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Instance bf9ad663-b4d8-4426-a4f6-10e822acda74 could not be found. Aug 09 18:33:33.567115 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': 'bf9ad663-b4d8-4426-a4f6-10e822acda74'} Aug 09 18:33:33.568113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:33:33.568113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:33.568113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:33:33.568113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:33:33.568113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:33:33.568113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:33:33.568113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:33:33.568113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:33:33.568113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:33:33.568113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:33:33.568113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf9ad663-b4d8-4426-a4f6-10e822acda74 could not be found. Aug 09 18:33:33.568113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:33:33.568113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:33:33.568113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:33:33.568113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:33.568113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:33:33.568113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:33:33.568113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:33:33.568113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:33:33.568113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:33:33.569681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:33:33.569681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:33:33.569681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:33:33.569681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:33:33.569681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:33:33.569681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:33:33.569681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:33:33.569681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf9ad663-b4d8-4426-a4f6-10e822acda74 could not be found. Aug 09 18:33:33.569681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:33:33.569681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:33:33.569681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:33:33.569681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:33.569681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:33:33.569681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:33:33.569681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:33:33.569681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:33:33.569681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf9ad663-b4d8-4426-a4f6-10e822acda74 could not be found. Aug 09 18:33:33.569681 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:33:33.570994 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f0e7eab6-7493-4f9c-a18a-06059fa5e6b7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Returning 404 to user: Instance bf9ad663-b4d8-4426-a4f6-10e822acda74 could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:33:33.570994 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f0e7eab6-7493-4f9c-a18a-06059fa5e6b7 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74" status: 404 len: 111 microversion: 2.1 time: 0.031589 Aug 09 18:33:33.570994 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 570/1115] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:33 2022] GET /compute/v2.1/servers/bf9ad663-b4d8-4426-a4f6-10e822acda74 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:33:34.829819 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-7d2b753e-f0c2-46d4-adc2-8ae8b7c5d5d1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:34.830342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-7d2b753e-f0c2-46d4-adc2-8ae8b7c5d5d1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:34.837020 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7d2b753e-f0c2-46d4-adc2-8ae8b7c5d5d1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:34.837507 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7d2b753e-f0c2-46d4-adc2-8ae8b7c5d5d1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:34.837974 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7d2b753e-f0c2-46d4-adc2-8ae8b7c5d5d1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:34.838666 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7d2b753e-f0c2-46d4-adc2-8ae8b7c5d5d1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:34.839147 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7d2b753e-f0c2-46d4-adc2-8ae8b7c5d5d1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:34.839572 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-7d2b753e-f0c2-46d4-adc2-8ae8b7c5d5d1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:34.854081 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-7d2b753e-f0c2-46d4-adc2-8ae8b7c5d5d1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] HTTP exception thrown: Instance db129123-67b6-4f98-b981-85ae85ddffb4 could not be found. Aug 09 18:33:34.855664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-7d2b753e-f0c2-46d4-adc2-8ae8b7c5d5d1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Request method failure captured: Aug 09 18:33:34.855664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: DELETE /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4 HTTP/1.1 Aug 09 18:33:34.855664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:33:34.855664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:33:34.855664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:33:34.855664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 0 Aug 09 18:33:34.855664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:33:34.855664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:33:34.855664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:33:34.855664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:33:34.855664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qbq-DOR3BxtGwkou5FwWz3xCIphiCip_GcoqUJfS6TCAlx9byuBwIsmvUqfP7bc54bYmFRCJl-p5wNCqL_fYghaK74o19PAt7cT5_Jm9E5N7e6fbCSxsZ4jxot64kXs_bht-AoiM83Iuo9LFBE11D8xofJdBHQ3q85AlPLOazPfMOg Aug 09 18:33:34.855664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:33:34.855664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:33:34.855664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:33:34.855664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:33:34.855664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:33:34.855664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:33:34.855664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:33:34.855664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:34.855664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:33:34.855664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:33:34.857354 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ef103f8a63404f918eaa5dd0c626b4c0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:33:34.857354 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:34.857354 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:33:34.857354 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:34.857354 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:33:34.857354 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:33:34.857354 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:33:34.857354 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: b5ffbaec36054aa3a89cca8b6007c8bb Aug 09 18:33:34.857354 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:33:34.857354 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: > Aug 09 18:33:34.857354 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Instance db129123-67b6-4f98-b981-85ae85ddffb4 could not be found. Aug 09 18:33:34.857354 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'id': 'db129123-67b6-4f98-b981-85ae85ddffb4'} Aug 09 18:33:34.858139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:33:34.858139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:34.858139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:33:34.858139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:33:34.858139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:33:34.858139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:33:34.858139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:33:34.858139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:33:34.858139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:33:34.858139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:33:34.858139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db129123-67b6-4f98-b981-85ae85ddffb4 could not be found. Aug 09 18:33:34.858139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:34.858139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:33:34.858139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:34.858139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:34.858139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:33:34.858139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:33:34.858139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:33:34.858139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:33:34.858139 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:33:34.859453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:33:34.859453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:33:34.859453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:33:34.859453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:33:34.859453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:33:34.859453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:33:34.859453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:33:34.859453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:33:34.859453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:33:34.859453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db129123-67b6-4f98-b981-85ae85ddffb4 could not be found. Aug 09 18:33:34.859453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:34.859453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:33:34.859453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:34.859453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:34.859453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:33:34.859453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:33:34.859453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:33:34.859453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:33:34.859453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db129123-67b6-4f98-b981-85ae85ddffb4 could not be found. Aug 09 18:33:34.859453 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:34.860768 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-7d2b753e-f0c2-46d4-adc2-8ae8b7c5d5d1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Returning 404 to user: Instance db129123-67b6-4f98-b981-85ae85ddffb4 could not be found. {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:33:34.860768 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-7d2b753e-f0c2-46d4-adc2-8ae8b7c5d5d1 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "DELETE /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4" status: 404 len: 111 microversion: 2.1 time: 0.031616 Aug 09 18:33:34.860768 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 546/1116] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:33:34 2022] DELETE /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:33:34.865795 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-41893393-36c2-4766-8352-c61bf23b0a57 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:34.866424 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-41893393-36c2-4766-8352-c61bf23b0a57 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: db129123-67b6-4f98-b981-85ae85ddffb4] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:34.873068 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-41893393-36c2-4766-8352-c61bf23b0a57 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:34.873650 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-41893393-36c2-4766-8352-c61bf23b0a57 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:34.874084 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-41893393-36c2-4766-8352-c61bf23b0a57 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:34.874793 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-41893393-36c2-4766-8352-c61bf23b0a57 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:34.875245 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-41893393-36c2-4766-8352-c61bf23b0a57 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:34.875682 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-41893393-36c2-4766-8352-c61bf23b0a57 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:34.889097 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-41893393-36c2-4766-8352-c61bf23b0a57 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] HTTP exception thrown: Instance db129123-67b6-4f98-b981-85ae85ddffb4 could not be found. Aug 09 18:33:34.890690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-41893393-36c2-4766-8352-c61bf23b0a57 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Request method failure captured: Aug 09 18:33:34.890690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4 HTTP/1.1 Aug 09 18:33:34.890690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:33:34.890690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:33:34.890690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:33:34.890690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:33:34.890690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:33:34.890690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:33:34.890690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:33:34.890690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:33:34.890690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qbq-DOR3BxtGwkou5FwWz3xCIphiCip_GcoqUJfS6TCAlx9byuBwIsmvUqfP7bc54bYmFRCJl-p5wNCqL_fYghaK74o19PAt7cT5_Jm9E5N7e6fbCSxsZ4jxot64kXs_bht-AoiM83Iuo9LFBE11D8xofJdBHQ3q85AlPLOazPfMOg Aug 09 18:33:34.890690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:33:34.890690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:33:34.890690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:33:34.890690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:33:34.890690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:33:34.890690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:33:34.890690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:33:34.890690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:34.890690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:33:34.890690 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:33:34.892355 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ef103f8a63404f918eaa5dd0c626b4c0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:33:34.892355 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:34.892355 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:33:34.892355 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:34.892355 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:33:34.892355 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:33:34.892355 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:33:34.892355 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: b5ffbaec36054aa3a89cca8b6007c8bb Aug 09 18:33:34.892355 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:33:34.892355 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:33:34.892355 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Instance db129123-67b6-4f98-b981-85ae85ddffb4 could not be found. Aug 09 18:33:34.892355 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': 'db129123-67b6-4f98-b981-85ae85ddffb4'} Aug 09 18:33:34.893408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:33:34.893408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:34.893408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:33:34.893408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:33:34.893408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:33:34.893408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:33:34.893408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:33:34.893408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:33:34.893408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:33:34.893408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:33:34.893408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db129123-67b6-4f98-b981-85ae85ddffb4 could not be found. Aug 09 18:33:34.893408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:33:34.893408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:33:34.893408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:33:34.893408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:34.893408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:33:34.893408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:33:34.893408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:33:34.893408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:33:34.893408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:33:34.894770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:33:34.894770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:33:34.894770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:33:34.894770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:33:34.894770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:33:34.894770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:33:34.894770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:33:34.894770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db129123-67b6-4f98-b981-85ae85ddffb4 could not be found. Aug 09 18:33:34.894770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:33:34.894770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:33:34.894770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:33:34.894770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:34.894770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:33:34.894770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:33:34.894770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:33:34.894770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:33:34.894770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db129123-67b6-4f98-b981-85ae85ddffb4 could not be found. Aug 09 18:33:34.894770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:33:34.896072 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-41893393-36c2-4766-8352-c61bf23b0a57 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Returning 404 to user: Instance db129123-67b6-4f98-b981-85ae85ddffb4 could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:33:34.896072 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-41893393-36c2-4766-8352-c61bf23b0a57 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4" status: 404 len: 111 microversion: 2.1 time: 0.030200 Aug 09 18:33:34.896072 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 571/1117] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:34 2022] GET /compute/v2.1/servers/db129123-67b6-4f98-b981-85ae85ddffb4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:33:34.900426 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-fab8cc69-7243-4b20-844f-4a54e391aaf9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:34.900917 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-fab8cc69-7243-4b20-844f-4a54e391aaf9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:34.907494 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fab8cc69-7243-4b20-844f-4a54e391aaf9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:34.907971 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fab8cc69-7243-4b20-844f-4a54e391aaf9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:34.908401 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fab8cc69-7243-4b20-844f-4a54e391aaf9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:34.909074 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fab8cc69-7243-4b20-844f-4a54e391aaf9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:34.909521 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fab8cc69-7243-4b20-844f-4a54e391aaf9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:34.909936 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fab8cc69-7243-4b20-844f-4a54e391aaf9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:34.922890 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-fab8cc69-7243-4b20-844f-4a54e391aaf9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] HTTP exception thrown: Instance 75fbff94-7825-46ec-87c1-04cf653b3c29 could not be found. Aug 09 18:33:34.924404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-fab8cc69-7243-4b20-844f-4a54e391aaf9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Request method failure captured: Aug 09 18:33:34.924404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: DELETE /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29 HTTP/1.1 Aug 09 18:33:34.924404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:33:34.924404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:33:34.924404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:33:34.924404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 0 Aug 09 18:33:34.924404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:33:34.924404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:33:34.924404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:33:34.924404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:33:34.924404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qbq-DOR3BxtGwkou5FwWz3xCIphiCip_GcoqUJfS6TCAlx9byuBwIsmvUqfP7bc54bYmFRCJl-p5wNCqL_fYghaK74o19PAt7cT5_Jm9E5N7e6fbCSxsZ4jxot64kXs_bht-AoiM83Iuo9LFBE11D8xofJdBHQ3q85AlPLOazPfMOg Aug 09 18:33:34.924404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:33:34.924404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:33:34.924404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:33:34.924404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:33:34.924404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:33:34.924404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:33:34.924404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:33:34.924404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:34.924404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:33:34.924404 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:33:34.926039 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ef103f8a63404f918eaa5dd0c626b4c0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:33:34.926039 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:34.926039 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:33:34.926039 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:34.926039 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:33:34.926039 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:33:34.926039 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:33:34.926039 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: b5ffbaec36054aa3a89cca8b6007c8bb Aug 09 18:33:34.926039 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:33:34.926039 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: > Aug 09 18:33:34.926039 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Instance 75fbff94-7825-46ec-87c1-04cf653b3c29 could not be found. Aug 09 18:33:34.926039 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'id': '75fbff94-7825-46ec-87c1-04cf653b3c29'} Aug 09 18:33:34.927220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:33:34.927220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:34.927220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:33:34.927220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:33:34.927220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:33:34.927220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:33:34.927220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:33:34.927220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:33:34.927220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:33:34.927220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:33:34.927220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75fbff94-7825-46ec-87c1-04cf653b3c29 could not be found. Aug 09 18:33:34.927220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:34.927220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:33:34.927220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:34.927220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:34.927220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:33:34.927220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:33:34.927220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:33:34.927220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:33:34.927220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:33:34.928757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:33:34.928757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:33:34.928757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:33:34.928757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:33:34.928757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:33:34.928757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:33:34.928757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:33:34.928757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:33:34.928757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:33:34.928757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75fbff94-7825-46ec-87c1-04cf653b3c29 could not be found. Aug 09 18:33:34.928757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:34.928757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:33:34.928757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:34.928757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:34.928757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:33:34.928757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:33:34.928757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:33:34.928757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:33:34.928757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75fbff94-7825-46ec-87c1-04cf653b3c29 could not be found. Aug 09 18:33:34.928757 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:34.930413 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-fab8cc69-7243-4b20-844f-4a54e391aaf9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Returning 404 to user: Instance 75fbff94-7825-46ec-87c1-04cf653b3c29 could not be found. {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:33:34.930413 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-fab8cc69-7243-4b20-844f-4a54e391aaf9 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "DELETE /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29" status: 404 len: 111 microversion: 2.1 time: 0.029076 Aug 09 18:33:34.930413 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 547/1118] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:33:34 2022] DELETE /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:33:34.934035 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-1307be11-a362-4d05-b047-c0c71c34ad53 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:34.934651 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-1307be11-a362-4d05-b047-c0c71c34ad53 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 75fbff94-7825-46ec-87c1-04cf653b3c29] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:34.941547 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1307be11-a362-4d05-b047-c0c71c34ad53 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:34.942028 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1307be11-a362-4d05-b047-c0c71c34ad53 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:34.942460 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1307be11-a362-4d05-b047-c0c71c34ad53 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:34.943181 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1307be11-a362-4d05-b047-c0c71c34ad53 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:34.943634 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1307be11-a362-4d05-b047-c0c71c34ad53 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:34.944057 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-1307be11-a362-4d05-b047-c0c71c34ad53 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:34.957924 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-1307be11-a362-4d05-b047-c0c71c34ad53 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] HTTP exception thrown: Instance 75fbff94-7825-46ec-87c1-04cf653b3c29 could not be found. Aug 09 18:33:34.959452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-1307be11-a362-4d05-b047-c0c71c34ad53 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Request method failure captured: Aug 09 18:33:34.959452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29 HTTP/1.1 Aug 09 18:33:34.959452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:33:34.959452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:33:34.959452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:33:34.959452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:33:34.959452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:33:34.959452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:33:34.959452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:33:34.959452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:33:34.959452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qbq-DOR3BxtGwkou5FwWz3xCIphiCip_GcoqUJfS6TCAlx9byuBwIsmvUqfP7bc54bYmFRCJl-p5wNCqL_fYghaK74o19PAt7cT5_Jm9E5N7e6fbCSxsZ4jxot64kXs_bht-AoiM83Iuo9LFBE11D8xofJdBHQ3q85AlPLOazPfMOg Aug 09 18:33:34.959452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:33:34.959452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:33:34.959452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:33:34.959452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:33:34.959452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:33:34.959452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:33:34.959452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:33:34.959452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:34.959452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:33:34.959452 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:33:34.961056 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ef103f8a63404f918eaa5dd0c626b4c0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:33:34.961056 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:34.961056 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:33:34.961056 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:34.961056 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:33:34.961056 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:33:34.961056 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:33:34.961056 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: b5ffbaec36054aa3a89cca8b6007c8bb Aug 09 18:33:34.961056 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:33:34.961056 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:33:34.961056 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Instance 75fbff94-7825-46ec-87c1-04cf653b3c29 could not be found. Aug 09 18:33:34.961056 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': '75fbff94-7825-46ec-87c1-04cf653b3c29'} Aug 09 18:33:34.962050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:33:34.962050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:34.962050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:33:34.962050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:33:34.962050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:33:34.962050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:33:34.962050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:33:34.962050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:33:34.962050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:33:34.962050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:33:34.962050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75fbff94-7825-46ec-87c1-04cf653b3c29 could not be found. Aug 09 18:33:34.962050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:33:34.962050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:33:34.962050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:33:34.962050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:34.962050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:33:34.962050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:33:34.962050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:33:34.962050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:33:34.962050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:33:34.963586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:33:34.963586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:33:34.963586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:33:34.963586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:33:34.963586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:33:34.963586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:33:34.963586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:33:34.963586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75fbff94-7825-46ec-87c1-04cf653b3c29 could not be found. Aug 09 18:33:34.963586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:33:34.963586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:33:34.963586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:33:34.963586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:34.963586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:33:34.963586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:33:34.963586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:33:34.963586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:33:34.963586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75fbff94-7825-46ec-87c1-04cf653b3c29 could not be found. Aug 09 18:33:34.963586 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:33:34.965156 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-1307be11-a362-4d05-b047-c0c71c34ad53 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Returning 404 to user: Instance 75fbff94-7825-46ec-87c1-04cf653b3c29 could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:33:34.965156 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-1307be11-a362-4d05-b047-c0c71c34ad53 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29" status: 404 len: 111 microversion: 2.1 time: 0.030647 Aug 09 18:33:34.965156 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 572/1119] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:34 2022] GET /compute/v2.1/servers/75fbff94-7825-46ec-87c1-04cf653b3c29 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:33:36.267077 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-0b7f944f-0062-45de-8089-3f1c789813d8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:36.267563 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-0b7f944f-0062-45de-8089-3f1c789813d8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:36.273847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0b7f944f-0062-45de-8089-3f1c789813d8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:36.274330 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0b7f944f-0062-45de-8089-3f1c789813d8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:36.274791 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0b7f944f-0062-45de-8089-3f1c789813d8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:36.275479 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0b7f944f-0062-45de-8089-3f1c789813d8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:36.275929 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0b7f944f-0062-45de-8089-3f1c789813d8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:36.276347 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0b7f944f-0062-45de-8089-3f1c789813d8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:36.290020 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-0b7f944f-0062-45de-8089-3f1c789813d8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] HTTP exception thrown: Instance 4c609d78-f837-46cf-b7fa-4e65f8936312 could not be found. Aug 09 18:33:36.291578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-0b7f944f-0062-45de-8089-3f1c789813d8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Request method failure captured: Aug 09 18:33:36.291578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: DELETE /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 HTTP/1.1 Aug 09 18:33:36.291578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:33:36.291578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:33:36.291578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:33:36.291578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 0 Aug 09 18:33:36.291578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:33:36.291578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:33:36.291578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:33:36.291578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:33:36.291578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qbq-DOR3BxtGwkou5FwWz3xCIphiCip_GcoqUJfS6TCAlx9byuBwIsmvUqfP7bc54bYmFRCJl-p5wNCqL_fYghaK74o19PAt7cT5_Jm9E5N7e6fbCSxsZ4jxot64kXs_bht-AoiM83Iuo9LFBE11D8xofJdBHQ3q85AlPLOazPfMOg Aug 09 18:33:36.291578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:33:36.291578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:33:36.291578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:33:36.291578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:33:36.291578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:33:36.291578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:33:36.291578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:33:36.291578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:36.291578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:33:36.291578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:33:36.293259 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ef103f8a63404f918eaa5dd0c626b4c0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:33:36.293259 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:36.293259 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:33:36.293259 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:36.293259 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:33:36.293259 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:33:36.293259 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:33:36.293259 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: b5ffbaec36054aa3a89cca8b6007c8bb Aug 09 18:33:36.293259 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:33:36.293259 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: > Aug 09 18:33:36.293259 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Instance 4c609d78-f837-46cf-b7fa-4e65f8936312 could not be found. Aug 09 18:33:36.293259 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'id': '4c609d78-f837-46cf-b7fa-4e65f8936312'} Aug 09 18:33:36.294342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:33:36.294342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:36.294342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:33:36.294342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:33:36.294342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:33:36.294342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:33:36.294342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:33:36.294342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:33:36.294342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:33:36.294342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:33:36.294342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c609d78-f837-46cf-b7fa-4e65f8936312 could not be found. Aug 09 18:33:36.294342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:36.294342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:33:36.294342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:36.294342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:36.294342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:33:36.294342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:33:36.294342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:33:36.294342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:33:36.294342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:33:36.297185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:33:36.297185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:33:36.297185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:33:36.297185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:33:36.297185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:33:36.297185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:33:36.297185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:33:36.297185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:33:36.297185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:33:36.297185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c609d78-f837-46cf-b7fa-4e65f8936312 could not be found. Aug 09 18:33:36.297185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:36.297185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:33:36.297185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:36.297185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:36.297185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:33:36.297185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:33:36.297185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:33:36.297185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:33:36.297185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c609d78-f837-46cf-b7fa-4e65f8936312 could not be found. Aug 09 18:33:36.297185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:33:36.298745 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-0b7f944f-0062-45de-8089-3f1c789813d8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Returning 404 to user: Instance 4c609d78-f837-46cf-b7fa-4e65f8936312 could not be found. {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:33:36.298745 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-0b7f944f-0062-45de-8089-3f1c789813d8 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312" status: 404 len: 111 microversion: 2.1 time: 0.029852 Aug 09 18:33:36.298745 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 548/1120] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:33:36 2022] DELETE /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:33:36.302159 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2e35ce0c-2679-4820-b487-ac8e92979d46 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:36.302807 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-2e35ce0c-2679-4820-b487-ac8e92979d46 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] [instance: 4c609d78-f837-46cf-b7fa-4e65f8936312] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:36.308663 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2e35ce0c-2679-4820-b487-ac8e92979d46 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:36.309142 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2e35ce0c-2679-4820-b487-ac8e92979d46 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:36.309573 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2e35ce0c-2679-4820-b487-ac8e92979d46 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:36.310263 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2e35ce0c-2679-4820-b487-ac8e92979d46 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:36.310775 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2e35ce0c-2679-4820-b487-ac8e92979d46 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:36.311204 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2e35ce0c-2679-4820-b487-ac8e92979d46 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:36.324351 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-2e35ce0c-2679-4820-b487-ac8e92979d46 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] HTTP exception thrown: Instance 4c609d78-f837-46cf-b7fa-4e65f8936312 could not be found. Aug 09 18:33:36.325840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2e35ce0c-2679-4820-b487-ac8e92979d46 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Request method failure captured: Aug 09 18:33:36.325840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 HTTP/1.1 Aug 09 18:33:36.325840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:33:36.325840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:33:36.325840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:33:36.325840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:33:36.325840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:33:36.325840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:33:36.325840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:33:36.325840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:33:36.325840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qbq-DOR3BxtGwkou5FwWz3xCIphiCip_GcoqUJfS6TCAlx9byuBwIsmvUqfP7bc54bYmFRCJl-p5wNCqL_fYghaK74o19PAt7cT5_Jm9E5N7e6fbCSxsZ4jxot64kXs_bht-AoiM83Iuo9LFBE11D8xofJdBHQ3q85AlPLOazPfMOg Aug 09 18:33:36.325840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:33:36.325840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:33:36.325840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:33:36.325840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:33:36.325840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:33:36.325840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:33:36.325840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:33:36.325840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:36.325840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:33:36.325840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:33:36.327971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ef103f8a63404f918eaa5dd0c626b4c0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef103f8a63404f918eaa5dd0c626b4c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:33:36.327971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:36.327971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: ef103f8a63404f918eaa5dd0c626b4c0 Aug 09 18:33:36.327971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-150043754 Aug 09 18:33:36.327971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:33:36.327971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:33:36.327971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:33:36.327971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: b5ffbaec36054aa3a89cca8b6007c8bb Aug 09 18:33:36.327971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-AttachVolumeNegativeTest-150043754-project Aug 09 18:33:36.327971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:33:36.327971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Instance 4c609d78-f837-46cf-b7fa-4e65f8936312 could not be found. Aug 09 18:33:36.327971 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': '4c609d78-f837-46cf-b7fa-4e65f8936312'} Aug 09 18:33:36.328908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:33:36.328908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:36.328908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:33:36.328908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:33:36.328908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:33:36.328908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:33:36.328908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:33:36.328908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:33:36.328908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:33:36.328908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:33:36.328908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c609d78-f837-46cf-b7fa-4e65f8936312 could not be found. Aug 09 18:33:36.328908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:33:36.328908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:33:36.328908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:33:36.328908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:36.328908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:33:36.328908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:33:36.328908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:33:36.328908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:33:36.328908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:33:36.330397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:33:36.330397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:33:36.330397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:33:36.330397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:33:36.330397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:33:36.330397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:33:36.330397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:33:36.330397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c609d78-f837-46cf-b7fa-4e65f8936312 could not be found. Aug 09 18:33:36.330397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:33:36.330397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:33:36.330397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:33:36.330397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:36.330397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:33:36.330397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:33:36.330397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:33:36.330397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:33:36.330397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c609d78-f837-46cf-b7fa-4e65f8936312 could not be found. Aug 09 18:33:36.330397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:33:36.331779 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2e35ce0c-2679-4820-b487-ac8e92979d46 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] Returning 404 to user: Instance 4c609d78-f837-46cf-b7fa-4e65f8936312 could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:33:36.331779 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-2e35ce0c-2679-4820-b487-ac8e92979d46 tempest-AttachVolumeNegativeTest-150043754 tempest-AttachVolumeNegativeTest-150043754-project] 10.222.0.36 "GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312" status: 404 len: 111 microversion: 2.1 time: 0.029012 Aug 09 18:33:36.331779 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 573/1121] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:36 2022] GET /compute/v2.1/servers/4c609d78-f837-46cf-b7fa-4e65f8936312 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:33:43.512755 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-9cbfb05e-587a-4db1-9c6e-b855c420a968 tempest-VolumesTestJSON-1255417720 tempest-VolumesTestJSON-1255417720-project] Calling method '.version_select at 0x7f4c35244c10>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:43.560604 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-9cbfb05e-587a-4db1-9c6e-b855c420a968 tempest-VolumesTestJSON-1255417720 tempest-VolumesTestJSON-1255417720-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/59d44ab7-cc94-4084-97aa-76230d2df5a0" status: 200 len: 351 microversion: 2.1 time: 0.051727 Aug 09 18:33:43.561742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 549/1122] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Aug 9 18:33:43 2022] GET /compute/v2.1/os-volumes/59d44ab7-cc94-4084-97aa-76230d2df5a0 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:33:45.162518 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-abd74842-1819-4913-94aa-5ba5889ea070 tempest-VolumesTestJSON-1255417720 tempest-VolumesTestJSON-1255417720-project] Calling method '.version_select at 0x7f4c35d1cca0>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:45.210182 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-abd74842-1819-4913-94aa-5ba5889ea070 tempest-VolumesTestJSON-1255417720 tempest-VolumesTestJSON-1255417720-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/040279ae-ffe7-46d8-bff8-f53fd233aa52" status: 200 len: 351 microversion: 2.1 time: 0.051398 Aug 09 18:33:45.210767 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 574/1123] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Aug 9 18:33:45 2022] GET /compute/v2.1/os-volumes/040279ae-ffe7-46d8-bff8-f53fd233aa52 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:33:46.784122 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:33:46.784880 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:33:46.788731 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-19bc0c72-03e3-48da-a3a9-04ad8158f908 tempest-VolumesTestJSON-1255417720 tempest-VolumesTestJSON-1255417720-project] Calling method '.version_select at 0x7f4c35310820>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:46.837232 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-19bc0c72-03e3-48da-a3a9-04ad8158f908 tempest-VolumesTestJSON-1255417720 tempest-VolumesTestJSON-1255417720-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/9e2ca267-1e83-4771-ba92-984b3484a436" status: 200 len: 350 microversion: 2.1 time: 0.054285 Aug 09 18:33:46.837803 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 550/1124] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Aug 9 18:33:46 2022] GET /compute/v2.1/os-volumes/9e2ca267-1e83-4771-ba92-984b3484a436 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:33:46.848067 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:33:46.848841 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:33:46.852523 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-362f78a4-32a1-49fe-b62b-a38fc8a8ff4a tempest-VolumesTestJSON-1255417720 tempest-VolumesTestJSON-1255417720-project] Calling method '.version_select at 0x7f4c351b3550>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:46.937823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-362f78a4-32a1-49fe-b62b-a38fc8a8ff4a tempest-VolumesTestJSON-1255417720 tempest-VolumesTestJSON-1255417720-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090960 Aug 09 18:33:46.938381 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 575/1125] 10.222.0.36 () {58 vars in 1134 bytes} [Tue Aug 9 18:33:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:33:46.952010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-e85b6973-c308-4fb9-a29a-5f711c431b5b tempest-VolumesTestJSON-1255417720 tempest-VolumesTestJSON-1255417720-project] Calling method '.version_select at 0x7f4c353211f0>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:47.033993 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-e85b6973-c308-4fb9-a29a-5f711c431b5b tempest-VolumesTestJSON-1255417720 tempest-VolumesTestJSON-1255417720-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085710 Aug 09 18:33:47.034598 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 551/1126] 10.222.0.36 () {58 vars in 1149 bytes} [Tue Aug 9 18:33:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:33:47.050833 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-feeefa5b-07bc-4260-87b9-c03b6bdeeba2 tempest-VolumesTestJSON-1255417720 tempest-VolumesTestJSON-1255417720-project] Calling method '.version_select at 0x7f4c35308160>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:47.132536 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-feeefa5b-07bc-4260-87b9-c03b6bdeeba2 tempest-VolumesTestJSON-1255417720 tempest-VolumesTestJSON-1255417720-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086867 Aug 09 18:33:47.133098 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 576/1127] 10.222.0.36 () {58 vars in 1134 bytes} [Tue Aug 9 18:33:47 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:33:47.146589 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-2965e094-2355-4fe4-b7e4-5e6db907cfd5 tempest-VolumesTestJSON-1255417720 tempest-VolumesTestJSON-1255417720-project] Calling method '.version_select at 0x7f4c35373790>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:47.231664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-2965e094-2355-4fe4-b7e4-5e6db907cfd5 tempest-VolumesTestJSON-1255417720 tempest-VolumesTestJSON-1255417720-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088759 Aug 09 18:33:47.232239 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 552/1128] 10.222.0.36 () {58 vars in 1167 bytes} [Tue Aug 9 18:33:47 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:33:47.245180 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f9a4dd37-e2e1-48cb-adc5-5078177de444 tempest-VolumesTestJSON-1255417720 tempest-VolumesTestJSON-1255417720-project] Calling method '.version_select at 0x7f4c352465e0>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:47.325769 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f9a4dd37-e2e1-48cb-adc5-5078177de444 tempest-VolumesTestJSON-1255417720 tempest-VolumesTestJSON-1255417720-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.084380 Aug 09 18:33:47.326343 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 577/1129] 10.222.0.36 () {58 vars in 1170 bytes} [Tue Aug 9 18:33:47 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:33:47.340278 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-3e140b27-3a0f-44f6-9fec-e77f35a9d939 tempest-VolumesTestJSON-1255417720 tempest-VolumesTestJSON-1255417720-project] Calling method '.version_select at 0x7f4c35448040>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:47.424258 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-3e140b27-3a0f-44f6-9fec-e77f35a9d939 tempest-VolumesTestJSON-1255417720 tempest-VolumesTestJSON-1255417720-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087823 Aug 09 18:33:47.424855 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 553/1130] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Aug 9 18:33:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:33:47.438086 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-3fa00e62-3cfe-4be3-beda-d3c2fe101a3c tempest-VolumesTestJSON-1255417720 tempest-VolumesTestJSON-1255417720-project] Calling method '.version_select at 0x7f4c3548a820>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:47.521125 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-3fa00e62-3cfe-4be3-beda-d3c2fe101a3c tempest-VolumesTestJSON-1255417720 tempest-VolumesTestJSON-1255417720-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087445 Aug 09 18:33:47.521689 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 578/1131] 10.222.0.36 () {58 vars in 1188 bytes} [Tue Aug 9 18:33:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:33:47.534475 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d224593c-a744-4c67-a187-80e93ddd22f5 tempest-VolumesTestJSON-1255417720 tempest-VolumesTestJSON-1255417720-project] Calling method '.version_select at 0x7f4c35448550>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:47.787318 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d224593c-a744-4c67-a187-80e93ddd22f5 tempest-VolumesTestJSON-1255417720 tempest-VolumesTestJSON-1255417720-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.256471 Aug 09 18:33:47.787915 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 554/1132] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Aug 9 18:33:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:13.532810 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d42ffea7-c8b5-424f-9c66-41721b0bd949 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-670481049", "imageRef": "53732c26-c942-4646-ac3f-8d9e11ab4d57", "flavorRef": "452", "networks": [{"uuid": "bc8641c6-6d5d-4729-aef7-a2b43296400c"}]}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:34:13.585476 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.network.neutron [None req-d42ffea7-c8b5-424f-9c66-41721b0bd949 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] validate_networks() for [('bc8641c6-6d5d-4729-aef7-a2b43296400c', None, None, None, None, None)] {{(pid=118313) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:34:13.972466 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-d42ffea7-c8b5-424f-9c66-41721b0bd949 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Flavor limits 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:34:13.972919 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-d42ffea7-c8b5-424f-9c66-41721b0bd949 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Image limits 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:34:13.973391 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-d42ffea7-c8b5-424f-9c66-41721b0bd949 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Flavor pref 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:34:13.973800 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-d42ffea7-c8b5-424f-9c66-41721b0bd949 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Image pref 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:34:13.974211 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-d42ffea7-c8b5-424f-9c66-41721b0bd949 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:34:13.983054 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d42ffea7-c8b5-424f-9c66-41721b0bd949 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:13.983534 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d42ffea7-c8b5-424f-9c66-41721b0bd949 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:13.983964 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d42ffea7-c8b5-424f-9c66-41721b0bd949 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:13.984687 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d42ffea7-c8b5-424f-9c66-41721b0bd949 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:13.985141 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d42ffea7-c8b5-424f-9c66-41721b0bd949 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:13.985562 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d42ffea7-c8b5-424f-9c66-41721b0bd949 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:14.002757 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-d42ffea7-c8b5-424f-9c66-41721b0bd949 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Getting quotas for project 4f77a082a0324845b34bf0bbb33bc8bb. Resources: {'cores', 'instances', 'ram'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:34:14.006646 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-d42ffea7-c8b5-424f-9c66-41721b0bd949 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Getting quotas for user 32099f8214de4f5caebd0a68efdfb87f and project 4f77a082a0324845b34bf0bbb33bc8bb. Resources: {'cores', 'instances', 'ram'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:34:14.017579 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d42ffea7-c8b5-424f-9c66-41721b0bd949 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Going to run 1 instances... {{(pid=118313) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:34:14.019836 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d42ffea7-c8b5-424f-9c66-41721b0bd949 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 6dfae9c3-a04a-4290-b898-6fa06cd2b876] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53732c26-c942-4646-ac3f-8d9e11ab4d57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118313) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:34:14.125809 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d42ffea7-c8b5-424f-9c66-41721b0bd949 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597530 Aug 09 18:34:14.126485 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 579/1133] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Aug 9 18:34:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:34:14.137929 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-61559480-a8ea-4a52-ba90-69cbcfe97c7f tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:14.138545 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-61559480-a8ea-4a52-ba90-69cbcfe97c7f tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 6dfae9c3-a04a-4290-b898-6fa06cd2b876] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:14.193286 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-61559480-a8ea-4a52-ba90-69cbcfe97c7f tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:14.199974 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-61559480-a8ea-4a52-ba90-69cbcfe97c7f tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876" status: 200 len: 1213 microversion: 2.1 time: 0.066668 Aug 09 18:34:14.200531 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 555/1134] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:14 2022] GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876 => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:15.222095 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-05ce209a-d1bf-4367-af34-b968b486f2ae tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:15.223371 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-05ce209a-d1bf-4367-af34-b968b486f2ae tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 6dfae9c3-a04a-4290-b898-6fa06cd2b876] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:15.230323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-05ce209a-d1bf-4367-af34-b968b486f2ae tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:15.230843 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-05ce209a-d1bf-4367-af34-b968b486f2ae tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:15.231286 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-05ce209a-d1bf-4367-af34-b968b486f2ae tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:15.231990 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-05ce209a-d1bf-4367-af34-b968b486f2ae tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:15.232451 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-05ce209a-d1bf-4367-af34-b968b486f2ae tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:15.232881 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-05ce209a-d1bf-4367-af34-b968b486f2ae tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:15.300660 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-05ce209a-d1bf-4367-af34-b968b486f2ae tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:15.313006 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-05ce209a-d1bf-4367-af34-b968b486f2ae tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876" status: 200 len: 1217 microversion: 2.1 time: 0.095476 Aug 09 18:34:15.313598 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 580/1135] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:15 2022] GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876 => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:16.334602 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-a7f4fe00-7f48-4e4b-a851-10d8863ed420 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:16.335324 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-a7f4fe00-7f48-4e4b-a851-10d8863ed420 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 6dfae9c3-a04a-4290-b898-6fa06cd2b876] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:16.341817 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a7f4fe00-7f48-4e4b-a851-10d8863ed420 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:16.342308 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a7f4fe00-7f48-4e4b-a851-10d8863ed420 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:16.342822 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a7f4fe00-7f48-4e4b-a851-10d8863ed420 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:16.343487 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a7f4fe00-7f48-4e4b-a851-10d8863ed420 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:16.343950 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a7f4fe00-7f48-4e4b-a851-10d8863ed420 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:16.344380 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a7f4fe00-7f48-4e4b-a851-10d8863ed420 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:16.410321 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a7f4fe00-7f48-4e4b-a851-10d8863ed420 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:16.417818 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-a7f4fe00-7f48-4e4b-a851-10d8863ed420 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876" status: 200 len: 1283 microversion: 2.1 time: 0.087925 Aug 09 18:34:16.418603 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 556/1136] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:16 2022] GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876 => generated 1283 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:17.439343 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c600f364-2740-44ce-bdf5-3b2f8be5dbcb tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:17.440648 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-c600f364-2740-44ce-bdf5-3b2f8be5dbcb tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 6dfae9c3-a04a-4290-b898-6fa06cd2b876] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:17.446916 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c600f364-2740-44ce-bdf5-3b2f8be5dbcb tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:17.447421 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c600f364-2740-44ce-bdf5-3b2f8be5dbcb tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:17.447853 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c600f364-2740-44ce-bdf5-3b2f8be5dbcb tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:17.449008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c600f364-2740-44ce-bdf5-3b2f8be5dbcb tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:17.449008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c600f364-2740-44ce-bdf5-3b2f8be5dbcb tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:17.449385 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c600f364-2740-44ce-bdf5-3b2f8be5dbcb tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:17.667093 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-c600f364-2740-44ce-bdf5-3b2f8be5dbcb tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:17.675282 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-c600f364-2740-44ce-bdf5-3b2f8be5dbcb tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876" status: 200 len: 1313 microversion: 2.1 time: 0.239749 Aug 09 18:34:17.675863 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 581/1137] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:17 2022] GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:17.839064 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-ff9dc2a5-b2e2-4f3d-8230-cd144fda1537 req-4305693a-d193-411d-a43b-fc71372208fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dfae9c3-a04a-4290-b898-6fa06cd2b876", "tag": "fa1ce1a3-c4b3-48f8-9fb6-87a9181e941e"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:34:17.850151 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-ff9dc2a5-b2e2-4f3d-8230-cd144fda1537 req-4305693a-d193-411d-a43b-fc71372208fa service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:17.850628 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-ff9dc2a5-b2e2-4f3d-8230-cd144fda1537 req-4305693a-d193-411d-a43b-fc71372208fa service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:17.851140 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-ff9dc2a5-b2e2-4f3d-8230-cd144fda1537 req-4305693a-d193-411d-a43b-fc71372208fa service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:17.864059 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-ff9dc2a5-b2e2-4f3d-8230-cd144fda1537 req-4305693a-d193-411d-a43b-fc71372208fa service nova] Creating event network-changed:fa1ce1a3-c4b3-48f8-9fb6-87a9181e941e for instance 6dfae9c3-a04a-4290-b898-6fa06cd2b876 on hv-cinder-79797 Aug 09 18:34:17.869321 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-ff9dc2a5-b2e2-4f3d-8230-cd144fda1537 req-4305693a-d193-411d-a43b-fc71372208fa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033691 Aug 09 18:34:17.869765 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 557/1138] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:34:18.696280 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-71bb35bc-de52-44ec-9ed1-b52d5cf2a413 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:18.696887 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-71bb35bc-de52-44ec-9ed1-b52d5cf2a413 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 6dfae9c3-a04a-4290-b898-6fa06cd2b876] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:18.703991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-71bb35bc-de52-44ec-9ed1-b52d5cf2a413 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:18.704408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-71bb35bc-de52-44ec-9ed1-b52d5cf2a413 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:18.704845 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-71bb35bc-de52-44ec-9ed1-b52d5cf2a413 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:18.706415 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-71bb35bc-de52-44ec-9ed1-b52d5cf2a413 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:18.707099 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-71bb35bc-de52-44ec-9ed1-b52d5cf2a413 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:18.707532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-71bb35bc-de52-44ec-9ed1-b52d5cf2a413 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:18.850477 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-71bb35bc-de52-44ec-9ed1-b52d5cf2a413 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:18.857965 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-71bb35bc-de52-44ec-9ed1-b52d5cf2a413 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876" status: 200 len: 1313 microversion: 2.1 time: 0.165541 Aug 09 18:34:18.858454 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 582/1139] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:18 2022] GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:19.880053 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-579ae3d1-01b8-4a3b-8fc8-1cb93dd520ab tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:19.880746 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-579ae3d1-01b8-4a3b-8fc8-1cb93dd520ab tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 6dfae9c3-a04a-4290-b898-6fa06cd2b876] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:19.887409 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-579ae3d1-01b8-4a3b-8fc8-1cb93dd520ab tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:19.887885 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-579ae3d1-01b8-4a3b-8fc8-1cb93dd520ab tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:19.888316 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-579ae3d1-01b8-4a3b-8fc8-1cb93dd520ab tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:19.888999 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-579ae3d1-01b8-4a3b-8fc8-1cb93dd520ab tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:19.889448 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-579ae3d1-01b8-4a3b-8fc8-1cb93dd520ab tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:19.889981 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-579ae3d1-01b8-4a3b-8fc8-1cb93dd520ab tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:20.019882 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-579ae3d1-01b8-4a3b-8fc8-1cb93dd520ab tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:20.027274 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-579ae3d1-01b8-4a3b-8fc8-1cb93dd520ab tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876" status: 200 len: 1313 microversion: 2.1 time: 0.152047 Aug 09 18:34:20.027871 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 558/1140] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:19 2022] GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:21.048488 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-3192c7cb-8779-458e-923f-7fc8a110f08a tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:21.049581 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-3192c7cb-8779-458e-923f-7fc8a110f08a tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 6dfae9c3-a04a-4290-b898-6fa06cd2b876] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:21.055974 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3192c7cb-8779-458e-923f-7fc8a110f08a tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:21.056464 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3192c7cb-8779-458e-923f-7fc8a110f08a tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:21.056908 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3192c7cb-8779-458e-923f-7fc8a110f08a tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:21.057604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3192c7cb-8779-458e-923f-7fc8a110f08a tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:21.058060 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3192c7cb-8779-458e-923f-7fc8a110f08a tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:21.058486 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-3192c7cb-8779-458e-923f-7fc8a110f08a tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:21.200377 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-3192c7cb-8779-458e-923f-7fc8a110f08a tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:21.208276 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-3192c7cb-8779-458e-923f-7fc8a110f08a tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876" status: 200 len: 1313 microversion: 2.1 time: 0.163736 Aug 09 18:34:21.208852 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 583/1141] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:21 2022] GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:22.231429 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-61e5399b-d4ea-49eb-b83c-a4298fa66a41 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:22.232073 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-61e5399b-d4ea-49eb-b83c-a4298fa66a41 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 6dfae9c3-a04a-4290-b898-6fa06cd2b876] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:22.238732 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-61e5399b-d4ea-49eb-b83c-a4298fa66a41 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:22.239218 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-61e5399b-d4ea-49eb-b83c-a4298fa66a41 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:22.239652 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-61e5399b-d4ea-49eb-b83c-a4298fa66a41 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:22.240342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-61e5399b-d4ea-49eb-b83c-a4298fa66a41 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:22.240794 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-61e5399b-d4ea-49eb-b83c-a4298fa66a41 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:22.241216 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-61e5399b-d4ea-49eb-b83c-a4298fa66a41 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:22.368703 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-61e5399b-d4ea-49eb-b83c-a4298fa66a41 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:22.376016 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-61e5399b-d4ea-49eb-b83c-a4298fa66a41 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876" status: 200 len: 1313 microversion: 2.1 time: 0.148637 Aug 09 18:34:22.376565 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 559/1142] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:22 2022] GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:23.397528 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-5d5778a2-bad0-4992-9c36-a6f60de4ea33 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:23.398218 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-5d5778a2-bad0-4992-9c36-a6f60de4ea33 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 6dfae9c3-a04a-4290-b898-6fa06cd2b876] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:23.404422 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d5778a2-bad0-4992-9c36-a6f60de4ea33 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:23.404910 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d5778a2-bad0-4992-9c36-a6f60de4ea33 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:23.405347 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d5778a2-bad0-4992-9c36-a6f60de4ea33 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:23.406062 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d5778a2-bad0-4992-9c36-a6f60de4ea33 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:23.406520 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d5778a2-bad0-4992-9c36-a6f60de4ea33 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:23.406970 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-5d5778a2-bad0-4992-9c36-a6f60de4ea33 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:23.535006 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-31016487-d2be-4d90-80f3-3b5be701ae09 req-31e87256-1e4d-4d66-a032-fbf72b1d5d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dfae9c3-a04a-4290-b898-6fa06cd2b876", "name": "network-vif-plugged", "status": "completed", "tag": "fa1ce1a3-c4b3-48f8-9fb6-87a9181e941e"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:34:23.544424 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-31016487-d2be-4d90-80f3-3b5be701ae09 req-31e87256-1e4d-4d66-a032-fbf72b1d5d2a service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:23.544930 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-31016487-d2be-4d90-80f3-3b5be701ae09 req-31e87256-1e4d-4d66-a032-fbf72b1d5d2a service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:23.545362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-31016487-d2be-4d90-80f3-3b5be701ae09 req-31e87256-1e4d-4d66-a032-fbf72b1d5d2a service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:23.552926 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-5d5778a2-bad0-4992-9c36-a6f60de4ea33 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:23.556568 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-31016487-d2be-4d90-80f3-3b5be701ae09 req-31e87256-1e4d-4d66-a032-fbf72b1d5d2a service nova] Creating event network-vif-plugged:fa1ce1a3-c4b3-48f8-9fb6-87a9181e941e for instance 6dfae9c3-a04a-4290-b898-6fa06cd2b876 on hv-cinder-79797 Aug 09 18:34:23.560494 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-5d5778a2-bad0-4992-9c36-a6f60de4ea33 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876" status: 200 len: 1313 microversion: 2.1 time: 0.166834 Aug 09 18:34:23.561075 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 560/1143] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:23 2022] GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:23.561642 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-31016487-d2be-4d90-80f3-3b5be701ae09 req-31e87256-1e4d-4d66-a032-fbf72b1d5d2a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191976 Aug 09 18:34:23.562469 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 584/1144] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:34:24.582271 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-80feff5f-8fba-442d-97e3-9ee4b48cb0b9 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:24.582946 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-80feff5f-8fba-442d-97e3-9ee4b48cb0b9 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 6dfae9c3-a04a-4290-b898-6fa06cd2b876] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:24.585040 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=2 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:34:24.590202 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-80feff5f-8fba-442d-97e3-9ee4b48cb0b9 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:24.590687 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-80feff5f-8fba-442d-97e3-9ee4b48cb0b9 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:24.591152 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-80feff5f-8fba-442d-97e3-9ee4b48cb0b9 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:24.591845 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-80feff5f-8fba-442d-97e3-9ee4b48cb0b9 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:24.592304 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-80feff5f-8fba-442d-97e3-9ee4b48cb0b9 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:24.592734 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-80feff5f-8fba-442d-97e3-9ee4b48cb0b9 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:24.728360 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-80feff5f-8fba-442d-97e3-9ee4b48cb0b9 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:24.735874 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-80feff5f-8fba-442d-97e3-9ee4b48cb0b9 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876" status: 200 len: 1313 microversion: 2.1 time: 0.158241 Aug 09 18:34:24.736989 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 561/1145] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:24 2022] GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:25.758003 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-dcffc4f8-6059-494a-af5a-069e8c57b4a3 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:25.758776 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-dcffc4f8-6059-494a-af5a-069e8c57b4a3 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 6dfae9c3-a04a-4290-b898-6fa06cd2b876] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:25.760760 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=2 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:34:25.761405 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=6 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:34:25.767074 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dcffc4f8-6059-494a-af5a-069e8c57b4a3 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:25.768081 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dcffc4f8-6059-494a-af5a-069e8c57b4a3 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:25.768660 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dcffc4f8-6059-494a-af5a-069e8c57b4a3 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:25.769283 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dcffc4f8-6059-494a-af5a-069e8c57b4a3 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:25.769736 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dcffc4f8-6059-494a-af5a-069e8c57b4a3 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:25.770187 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dcffc4f8-6059-494a-af5a-069e8c57b4a3 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:25.906407 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-dcffc4f8-6059-494a-af5a-069e8c57b4a3 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:25.913920 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-dcffc4f8-6059-494a-af5a-069e8c57b4a3 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876" status: 200 len: 1497 microversion: 2.1 time: 0.160224 Aug 09 18:34:25.914482 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 585/1146] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:25 2022] GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876 => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:26.626917 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-1f4373c9-a696-478a-b504-51cc7625e6ef tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:26.627566 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-1f4373c9-a696-478a-b504-51cc7625e6ef tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 6dfae9c3-a04a-4290-b898-6fa06cd2b876] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:26.633492 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1f4373c9-a696-478a-b504-51cc7625e6ef tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:26.633963 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1f4373c9-a696-478a-b504-51cc7625e6ef tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:26.634390 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1f4373c9-a696-478a-b504-51cc7625e6ef tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:26.635098 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1f4373c9-a696-478a-b504-51cc7625e6ef tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:26.635545 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1f4373c9-a696-478a-b504-51cc7625e6ef tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:26.635957 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1f4373c9-a696-478a-b504-51cc7625e6ef tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:26.662762 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-1f4373c9-a696-478a-b504-51cc7625e6ef tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 6dfae9c3-a04a-4290-b898-6fa06cd2b876] Going to try to terminate instance {{(pid=118314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:34:26.930288 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-1f4373c9-a696-478a-b504-51cc7625e6ef tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876" status: 204 len: 0 microversion: 2.1 time: 0.306799 Aug 09 18:34:26.930929 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 562/1147] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:34:26 2022] DELETE /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:34:26.939266 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-806498fe-eb75-4fed-9c19-7918117f4b29 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:26.940058 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-806498fe-eb75-4fed-9c19-7918117f4b29 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 6dfae9c3-a04a-4290-b898-6fa06cd2b876] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:26.946493 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-806498fe-eb75-4fed-9c19-7918117f4b29 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:26.947007 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-806498fe-eb75-4fed-9c19-7918117f4b29 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:26.947441 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-806498fe-eb75-4fed-9c19-7918117f4b29 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:26.948126 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-806498fe-eb75-4fed-9c19-7918117f4b29 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:26.948584 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-806498fe-eb75-4fed-9c19-7918117f4b29 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:26.949010 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-806498fe-eb75-4fed-9c19-7918117f4b29 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:27.078115 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-806498fe-eb75-4fed-9c19-7918117f4b29 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:27.086226 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-806498fe-eb75-4fed-9c19-7918117f4b29 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876" status: 200 len: 1503 microversion: 2.1 time: 0.150789 Aug 09 18:34:27.086813 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 586/1148] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:26 2022] GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:28.108782 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-057625da-5ad0-41e4-988d-ae2852581645 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:28.109480 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-057625da-5ad0-41e4-988d-ae2852581645 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 6dfae9c3-a04a-4290-b898-6fa06cd2b876] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:28.116239 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-057625da-5ad0-41e4-988d-ae2852581645 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:28.116661 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-057625da-5ad0-41e4-988d-ae2852581645 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:28.117097 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-057625da-5ad0-41e4-988d-ae2852581645 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:28.117785 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-057625da-5ad0-41e4-988d-ae2852581645 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:28.118236 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-057625da-5ad0-41e4-988d-ae2852581645 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:28.118656 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-057625da-5ad0-41e4-988d-ae2852581645 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:28.253269 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-057625da-5ad0-41e4-988d-ae2852581645 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:28.260768 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-057625da-5ad0-41e4-988d-ae2852581645 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876" status: 200 len: 1503 microversion: 2.1 time: 0.156176 Aug 09 18:34:28.261340 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 563/1149] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:28 2022] GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:29.066294 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-ce62b8c5-d8ff-4323-a811-643dcc2cf61b req-b9c8a057-80ef-4a2f-93be-1e8ef0692964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dfae9c3-a04a-4290-b898-6fa06cd2b876", "name": "network-vif-deleted", "tag": "fa1ce1a3-c4b3-48f8-9fb6-87a9181e941e"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:34:29.076687 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-ce62b8c5-d8ff-4323-a811-643dcc2cf61b req-b9c8a057-80ef-4a2f-93be-1e8ef0692964 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:29.078969 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-ce62b8c5-d8ff-4323-a811-643dcc2cf61b req-b9c8a057-80ef-4a2f-93be-1e8ef0692964 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:29.078969 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-ce62b8c5-d8ff-4323-a811-643dcc2cf61b req-b9c8a057-80ef-4a2f-93be-1e8ef0692964 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:29.088853 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-ce62b8c5-d8ff-4323-a811-643dcc2cf61b req-b9c8a057-80ef-4a2f-93be-1e8ef0692964 service nova] Creating event network-vif-deleted:fa1ce1a3-c4b3-48f8-9fb6-87a9181e941e for instance 6dfae9c3-a04a-4290-b898-6fa06cd2b876 on hv-cinder-79797 Aug 09 18:34:29.093672 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-ce62b8c5-d8ff-4323-a811-643dcc2cf61b req-b9c8a057-80ef-4a2f-93be-1e8ef0692964 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031682 Aug 09 18:34:29.094496 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 587/1150] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:34:29.282956 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-480da692-f8a5-4835-930d-ee1c90b1c469 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:29.283719 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-480da692-f8a5-4835-930d-ee1c90b1c469 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 6dfae9c3-a04a-4290-b898-6fa06cd2b876] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:29.289900 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-480da692-f8a5-4835-930d-ee1c90b1c469 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:29.290972 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-480da692-f8a5-4835-930d-ee1c90b1c469 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:29.290972 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-480da692-f8a5-4835-930d-ee1c90b1c469 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:29.291555 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-480da692-f8a5-4835-930d-ee1c90b1c469 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:29.292044 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-480da692-f8a5-4835-930d-ee1c90b1c469 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:29.292467 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-480da692-f8a5-4835-930d-ee1c90b1c469 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:29.358095 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-480da692-f8a5-4835-930d-ee1c90b1c469 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:29.366034 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-480da692-f8a5-4835-930d-ee1c90b1c469 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876" status: 200 len: 1298 microversion: 2.1 time: 0.087226 Aug 09 18:34:29.369481 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 564/1151] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:29 2022] GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876 => generated 1298 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:30.388639 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-60c01a23-df81-47c1-a5e7-69919d97ddc9 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:30.389334 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-60c01a23-df81-47c1-a5e7-69919d97ddc9 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 6dfae9c3-a04a-4290-b898-6fa06cd2b876] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:30.396083 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-60c01a23-df81-47c1-a5e7-69919d97ddc9 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:30.396567 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-60c01a23-df81-47c1-a5e7-69919d97ddc9 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:30.397007 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-60c01a23-df81-47c1-a5e7-69919d97ddc9 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:30.397695 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-60c01a23-df81-47c1-a5e7-69919d97ddc9 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:30.398177 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-60c01a23-df81-47c1-a5e7-69919d97ddc9 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:30.398604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-60c01a23-df81-47c1-a5e7-69919d97ddc9 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:30.411641 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-60c01a23-df81-47c1-a5e7-69919d97ddc9 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] HTTP exception thrown: Instance 6dfae9c3-a04a-4290-b898-6fa06cd2b876 could not be found. Aug 09 18:34:30.413236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-60c01a23-df81-47c1-a5e7-69919d97ddc9 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Request method failure captured: Aug 09 18:34:30.413236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876 HTTP/1.1 Aug 09 18:34:30.413236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:34:30.413236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:34:30.413236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:34:30.413236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:34:30.413236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:34:30.413236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:34:30.413236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:34:30.413236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:34:30.413236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qijwiskVaxG6wYqrNqIzFGTB5WAoyRW8MAt5QBrqeyu9vyW9zljxI8ac8TC8ZTAZbOVOi0sJcQZVLVCQXavyzOChtAiHWq3XbhpGWnmHTM_GD9EvO8KPm8KTay4Gz2rS6lTvIQjwFjbXcogLtKeCRwVlLVVK17MGRMYWInzsdwMVj4 Aug 09 18:34:30.413236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:34:30.413236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:34:30.413236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:34:30.413236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:34:30.413236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:34:30.413236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:34:30.413236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: 4f77a082a0324845b34bf0bbb33bc8bb Aug 09 18:34:30.413236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-VolumesActionsTest-2098598488 Aug 09 18:34:30.413236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:34:30.413236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:34:30.415150 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4f77a082a0324845b34bf0bbb33bc8bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4f77a082a0324845b34bf0bbb33bc8bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4f77a082a0324845b34bf0bbb33bc8bb", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4f77a082a0324845b34bf0bbb33bc8bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:34:30.415150 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-VolumesActionsTest-2098598488 Aug 09 18:34:30.415150 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: 4f77a082a0324845b34bf0bbb33bc8bb Aug 09 18:34:30.415150 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-VolumesActionsTest-2098598488 Aug 09 18:34:30.415150 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-VolumesActionsTest-2098598488-project Aug 09 18:34:30.415150 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:34:30.415150 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:34:30.415150 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: 32099f8214de4f5caebd0a68efdfb87f Aug 09 18:34:30.415150 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-VolumesActionsTest-2098598488-project Aug 09 18:34:30.415150 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:34:30.415150 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Instance 6dfae9c3-a04a-4290-b898-6fa06cd2b876 could not be found. Aug 09 18:34:30.415150 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': '6dfae9c3-a04a-4290-b898-6fa06cd2b876'} Aug 09 18:34:30.416188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:34:30.416188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:34:30.416188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:34:30.416188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:34:30.416188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:34:30.416188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:34:30.416188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:34:30.416188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:34:30.416188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:34:30.416188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:34:30.416188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dfae9c3-a04a-4290-b898-6fa06cd2b876 could not be found. Aug 09 18:34:30.416188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:34:30.416188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:34:30.416188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:34:30.416188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:34:30.416188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:34:30.416188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:34:30.416188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:34:30.416188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:34:30.416188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:34:30.417848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:34:30.417848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:34:30.417848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:34:30.417848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:34:30.417848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:34:30.417848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:34:30.417848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:34:30.417848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dfae9c3-a04a-4290-b898-6fa06cd2b876 could not be found. Aug 09 18:34:30.417848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:34:30.417848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:34:30.417848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:34:30.417848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:34:30.417848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:34:30.417848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:34:30.417848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:34:30.417848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:34:30.417848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dfae9c3-a04a-4290-b898-6fa06cd2b876 could not be found. Aug 09 18:34:30.417848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:34:30.419330 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-60c01a23-df81-47c1-a5e7-69919d97ddc9 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Returning 404 to user: Instance 6dfae9c3-a04a-4290-b898-6fa06cd2b876 could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:34:30.419330 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-60c01a23-df81-47c1-a5e7-69919d97ddc9 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876" status: 404 len: 111 microversion: 2.1 time: 0.030689 Aug 09 18:34:30.419330 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 588/1152] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:30 2022] GET /compute/v2.1/servers/6dfae9c3-a04a-4290-b898-6fa06cd2b876 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:34:30.464240 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-1dd79b04-9692-4b94-b03f-dd062fb3c018 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1820276364", "imageRef": "53732c26-c942-4646-ac3f-8d9e11ab4d57", "flavorRef": "452", "networks": [{"uuid": "bc8641c6-6d5d-4729-aef7-a2b43296400c"}]}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:34:30.516888 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.network.neutron [None req-1dd79b04-9692-4b94-b03f-dd062fb3c018 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] validate_networks() for [('bc8641c6-6d5d-4729-aef7-a2b43296400c', None, None, None, None, None)] {{(pid=118314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:34:30.920724 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-1dd79b04-9692-4b94-b03f-dd062fb3c018 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Flavor limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:34:30.921147 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-1dd79b04-9692-4b94-b03f-dd062fb3c018 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Image limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:34:30.921624 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-1dd79b04-9692-4b94-b03f-dd062fb3c018 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Flavor pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:34:30.922038 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-1dd79b04-9692-4b94-b03f-dd062fb3c018 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Image pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:34:30.922452 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-1dd79b04-9692-4b94-b03f-dd062fb3c018 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:34:30.931691 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1dd79b04-9692-4b94-b03f-dd062fb3c018 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:30.932176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1dd79b04-9692-4b94-b03f-dd062fb3c018 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:30.932613 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1dd79b04-9692-4b94-b03f-dd062fb3c018 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:30.933340 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1dd79b04-9692-4b94-b03f-dd062fb3c018 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:30.933797 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1dd79b04-9692-4b94-b03f-dd062fb3c018 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:30.934224 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1dd79b04-9692-4b94-b03f-dd062fb3c018 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:30.951372 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-1dd79b04-9692-4b94-b03f-dd062fb3c018 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Getting quotas for project 4f77a082a0324845b34bf0bbb33bc8bb. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:34:30.956034 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-1dd79b04-9692-4b94-b03f-dd062fb3c018 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Getting quotas for user 32099f8214de4f5caebd0a68efdfb87f and project 4f77a082a0324845b34bf0bbb33bc8bb. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:34:30.966817 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-1dd79b04-9692-4b94-b03f-dd062fb3c018 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Going to run 1 instances... {{(pid=118314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:34:30.969055 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-1dd79b04-9692-4b94-b03f-dd062fb3c018 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53732c26-c942-4646-ac3f-8d9e11ab4d57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:34:31.106920 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-1dd79b04-9692-4b94-b03f-dd062fb3c018 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646491 Aug 09 18:34:31.107783 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 565/1153] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Aug 9 18:34:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:34:31.118420 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e59dd81a-8266-4c1b-ae9e-0f8b9ad08c9d tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:31.119054 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e59dd81a-8266-4c1b-ae9e-0f8b9ad08c9d tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:31.173740 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e59dd81a-8266-4c1b-ae9e-0f8b9ad08c9d tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:31.180556 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e59dd81a-8266-4c1b-ae9e-0f8b9ad08c9d tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4" status: 200 len: 1214 microversion: 2.1 time: 0.065905 Aug 09 18:34:31.181152 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 589/1154] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:31 2022] GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:34:32.202493 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-0dff6548-7979-448f-8162-efb49c8b0266 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:32.203107 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-0dff6548-7979-448f-8162-efb49c8b0266 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:32.210265 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0dff6548-7979-448f-8162-efb49c8b0266 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:32.210772 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0dff6548-7979-448f-8162-efb49c8b0266 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:32.211260 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0dff6548-7979-448f-8162-efb49c8b0266 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:32.211953 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0dff6548-7979-448f-8162-efb49c8b0266 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:32.212405 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0dff6548-7979-448f-8162-efb49c8b0266 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:32.212828 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0dff6548-7979-448f-8162-efb49c8b0266 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:32.273407 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-0dff6548-7979-448f-8162-efb49c8b0266 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:32.281227 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-0dff6548-7979-448f-8162-efb49c8b0266 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4" status: 200 len: 1218 microversion: 2.1 time: 0.083109 Aug 09 18:34:32.281795 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 566/1155] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:32 2022] GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:33.301442 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-144a23fe-31f6-4991-9693-039b09b88a1c tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:33.302060 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-144a23fe-31f6-4991-9693-039b09b88a1c tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:33.309314 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-144a23fe-31f6-4991-9693-039b09b88a1c tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:33.309799 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-144a23fe-31f6-4991-9693-039b09b88a1c tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:33.310239 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-144a23fe-31f6-4991-9693-039b09b88a1c tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:33.310977 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-144a23fe-31f6-4991-9693-039b09b88a1c tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:33.311438 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-144a23fe-31f6-4991-9693-039b09b88a1c tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:33.311860 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-144a23fe-31f6-4991-9693-039b09b88a1c tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:33.389229 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-144a23fe-31f6-4991-9693-039b09b88a1c tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:33.397256 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-144a23fe-31f6-4991-9693-039b09b88a1c tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4" status: 200 len: 1272 microversion: 2.1 time: 0.099650 Aug 09 18:34:33.397823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 590/1156] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:33 2022] GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 => generated 1272 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:34.418815 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-98e9083c-a221-46c4-8402-08559e3aa505 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:34.419462 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-98e9083c-a221-46c4-8402-08559e3aa505 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:34.426360 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-98e9083c-a221-46c4-8402-08559e3aa505 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:34.426897 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-98e9083c-a221-46c4-8402-08559e3aa505 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:34.427334 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-98e9083c-a221-46c4-8402-08559e3aa505 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:34.428065 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-98e9083c-a221-46c4-8402-08559e3aa505 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:34.428521 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-98e9083c-a221-46c4-8402-08559e3aa505 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:34.428948 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-98e9083c-a221-46c4-8402-08559e3aa505 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:34.578607 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-98e9083c-a221-46c4-8402-08559e3aa505 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:34.586765 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-98e9083c-a221-46c4-8402-08559e3aa505 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4" status: 200 len: 1314 microversion: 2.1 time: 0.171952 Aug 09 18:34:34.587336 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 567/1157] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:34 2022] GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:34.619659 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-d4bddecc-370a-4389-9fa7-98cb9b9436f2 req-45418309-3d94-4df0-9820-ceffccba3394 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3199d6a1-9edb-4d12-9a8c-8dacd569e5a4", "tag": "562b60d1-ac3b-4002-97fd-9563dc2b4da6"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:34:34.629969 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-d4bddecc-370a-4389-9fa7-98cb9b9436f2 req-45418309-3d94-4df0-9820-ceffccba3394 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:34.630445 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-d4bddecc-370a-4389-9fa7-98cb9b9436f2 req-45418309-3d94-4df0-9820-ceffccba3394 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:34.630936 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-d4bddecc-370a-4389-9fa7-98cb9b9436f2 req-45418309-3d94-4df0-9820-ceffccba3394 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:34.642887 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-d4bddecc-370a-4389-9fa7-98cb9b9436f2 req-45418309-3d94-4df0-9820-ceffccba3394 service nova] Creating event network-changed:562b60d1-ac3b-4002-97fd-9563dc2b4da6 for instance 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 on hv-cinder-79797 Aug 09 18:34:34.647895 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-d4bddecc-370a-4389-9fa7-98cb9b9436f2 req-45418309-3d94-4df0-9820-ceffccba3394 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031993 Aug 09 18:34:34.649954 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 591/1158] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:34:35.607542 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-a11929ad-3b63-4425-adbf-c197a9224249 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:35.608173 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-a11929ad-3b63-4425-adbf-c197a9224249 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:35.615262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a11929ad-3b63-4425-adbf-c197a9224249 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:35.615742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a11929ad-3b63-4425-adbf-c197a9224249 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:35.616175 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a11929ad-3b63-4425-adbf-c197a9224249 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:35.616855 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a11929ad-3b63-4425-adbf-c197a9224249 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:35.617308 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a11929ad-3b63-4425-adbf-c197a9224249 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:35.617732 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-a11929ad-3b63-4425-adbf-c197a9224249 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:35.745506 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-a11929ad-3b63-4425-adbf-c197a9224249 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:35.752972 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-a11929ad-3b63-4425-adbf-c197a9224249 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4" status: 200 len: 1314 microversion: 2.1 time: 0.149233 Aug 09 18:34:35.753532 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 568/1159] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:35 2022] GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:36.774288 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-73e76947-fa6e-444f-8ac3-3cfb18ef76ba tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:36.775053 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-73e76947-fa6e-444f-8ac3-3cfb18ef76ba tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:36.781349 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-73e76947-fa6e-444f-8ac3-3cfb18ef76ba tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:36.781826 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-73e76947-fa6e-444f-8ac3-3cfb18ef76ba tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:36.782259 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-73e76947-fa6e-444f-8ac3-3cfb18ef76ba tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:36.782964 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-73e76947-fa6e-444f-8ac3-3cfb18ef76ba tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:36.783415 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-73e76947-fa6e-444f-8ac3-3cfb18ef76ba tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:36.783834 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-73e76947-fa6e-444f-8ac3-3cfb18ef76ba tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:36.913895 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-73e76947-fa6e-444f-8ac3-3cfb18ef76ba tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:36.921302 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-73e76947-fa6e-444f-8ac3-3cfb18ef76ba tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4" status: 200 len: 1314 microversion: 2.1 time: 0.151148 Aug 09 18:34:36.921986 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 592/1160] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:36 2022] GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:37.943810 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8382420e-5c5e-49be-96c6-090808fd4333 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:37.944682 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8382420e-5c5e-49be-96c6-090808fd4333 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:37.951927 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8382420e-5c5e-49be-96c6-090808fd4333 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:37.952416 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8382420e-5c5e-49be-96c6-090808fd4333 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:37.952852 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8382420e-5c5e-49be-96c6-090808fd4333 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:37.953545 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8382420e-5c5e-49be-96c6-090808fd4333 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:37.954005 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8382420e-5c5e-49be-96c6-090808fd4333 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:37.954428 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8382420e-5c5e-49be-96c6-090808fd4333 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:38.088136 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8382420e-5c5e-49be-96c6-090808fd4333 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:38.096144 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8382420e-5c5e-49be-96c6-090808fd4333 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4" status: 200 len: 1314 microversion: 2.1 time: 0.156816 Aug 09 18:34:38.097559 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 569/1161] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:37 2022] GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:39.116443 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5a980964-5ef5-4cd2-a2a2-10c47725991c tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:39.117051 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-5a980964-5ef5-4cd2-a2a2-10c47725991c tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:39.123480 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5a980964-5ef5-4cd2-a2a2-10c47725991c tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:39.123956 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5a980964-5ef5-4cd2-a2a2-10c47725991c tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:39.124384 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5a980964-5ef5-4cd2-a2a2-10c47725991c tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:39.125075 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5a980964-5ef5-4cd2-a2a2-10c47725991c tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:39.125521 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5a980964-5ef5-4cd2-a2a2-10c47725991c tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:39.125940 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5a980964-5ef5-4cd2-a2a2-10c47725991c tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:39.255951 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-5a980964-5ef5-4cd2-a2a2-10c47725991c tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:39.263291 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-5a980964-5ef5-4cd2-a2a2-10c47725991c tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4" status: 200 len: 1314 microversion: 2.1 time: 0.150797 Aug 09 18:34:39.264074 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 593/1162] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:39 2022] GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:39.494278 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-6f960948-28e0-4b92-a66f-c3a09cacc9c7 req-98e02b5e-7faf-4427-a787-509a10cd4cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3199d6a1-9edb-4d12-9a8c-8dacd569e5a4", "name": "network-vif-plugged", "status": "completed", "tag": "562b60d1-ac3b-4002-97fd-9563dc2b4da6"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:34:39.504843 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-6f960948-28e0-4b92-a66f-c3a09cacc9c7 req-98e02b5e-7faf-4427-a787-509a10cd4cd3 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:39.505331 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-6f960948-28e0-4b92-a66f-c3a09cacc9c7 req-98e02b5e-7faf-4427-a787-509a10cd4cd3 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:39.505763 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-6f960948-28e0-4b92-a66f-c3a09cacc9c7 req-98e02b5e-7faf-4427-a787-509a10cd4cd3 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:39.516578 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-6f960948-28e0-4b92-a66f-c3a09cacc9c7 req-98e02b5e-7faf-4427-a787-509a10cd4cd3 service nova] Creating event network-vif-plugged:562b60d1-ac3b-4002-97fd-9563dc2b4da6 for instance 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 on hv-cinder-79797 Aug 09 18:34:39.522392 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-6f960948-28e0-4b92-a66f-c3a09cacc9c7 req-98e02b5e-7faf-4427-a787-509a10cd4cd3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031930 Aug 09 18:34:39.523016 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 570/1163] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:34:40.284977 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-495f454b-c6b6-4d71-aa2d-17f9d0173ada tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:40.285606 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-495f454b-c6b6-4d71-aa2d-17f9d0173ada tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:40.292049 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-495f454b-c6b6-4d71-aa2d-17f9d0173ada tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:40.292535 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-495f454b-c6b6-4d71-aa2d-17f9d0173ada tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:40.292975 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-495f454b-c6b6-4d71-aa2d-17f9d0173ada tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:40.293694 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-495f454b-c6b6-4d71-aa2d-17f9d0173ada tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:40.294157 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-495f454b-c6b6-4d71-aa2d-17f9d0173ada tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:40.294583 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-495f454b-c6b6-4d71-aa2d-17f9d0173ada tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:40.427238 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-495f454b-c6b6-4d71-aa2d-17f9d0173ada tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:40.434563 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-495f454b-c6b6-4d71-aa2d-17f9d0173ada tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4" status: 200 len: 1314 microversion: 2.1 time: 0.154060 Aug 09 18:34:40.435146 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 594/1164] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:40 2022] GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:41.453574 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=2 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:34:41.454527 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=6 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:34:41.459092 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-0f8d5edf-3241-4a79-b56e-fc41d8b144cb tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:41.459808 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-0f8d5edf-3241-4a79-b56e-fc41d8b144cb tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:41.466176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0f8d5edf-3241-4a79-b56e-fc41d8b144cb tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:41.466669 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0f8d5edf-3241-4a79-b56e-fc41d8b144cb tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:41.467429 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0f8d5edf-3241-4a79-b56e-fc41d8b144cb tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:41.468535 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0f8d5edf-3241-4a79-b56e-fc41d8b144cb tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:41.469444 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0f8d5edf-3241-4a79-b56e-fc41d8b144cb tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:41.469613 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0f8d5edf-3241-4a79-b56e-fc41d8b144cb tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:41.602216 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-0f8d5edf-3241-4a79-b56e-fc41d8b144cb tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:41.609750 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-0f8d5edf-3241-4a79-b56e-fc41d8b144cb tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4" status: 200 len: 1314 microversion: 2.1 time: 0.157677 Aug 09 18:34:41.610309 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 571/1165] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:41 2022] GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:42.631604 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d8000c9d-f189-4ce0-8e5f-dce6f371c2a8 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:42.632146 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d8000c9d-f189-4ce0-8e5f-dce6f371c2a8 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:42.634021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=2 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:34:42.639154 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d8000c9d-f189-4ce0-8e5f-dce6f371c2a8 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:42.639626 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d8000c9d-f189-4ce0-8e5f-dce6f371c2a8 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:42.640054 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d8000c9d-f189-4ce0-8e5f-dce6f371c2a8 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:42.640726 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d8000c9d-f189-4ce0-8e5f-dce6f371c2a8 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:42.641179 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d8000c9d-f189-4ce0-8e5f-dce6f371c2a8 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:42.641582 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d8000c9d-f189-4ce0-8e5f-dce6f371c2a8 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:42.772471 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d8000c9d-f189-4ce0-8e5f-dce6f371c2a8 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:42.780285 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d8000c9d-f189-4ce0-8e5f-dce6f371c2a8 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4" status: 200 len: 1498 microversion: 2.1 time: 0.152641 Aug 09 18:34:42.784102 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 595/1166] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:42 2022] GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 => generated 1498 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:43.765643 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-07a6579f-cc59-4aa2-810b-ad9d896d6f57 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:43.766184 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-07a6579f-cc59-4aa2-810b-ad9d896d6f57 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:43.773308 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-07a6579f-cc59-4aa2-810b-ad9d896d6f57 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:43.773794 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-07a6579f-cc59-4aa2-810b-ad9d896d6f57 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:43.774235 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-07a6579f-cc59-4aa2-810b-ad9d896d6f57 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:43.774959 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-07a6579f-cc59-4aa2-810b-ad9d896d6f57 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:43.775421 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-07a6579f-cc59-4aa2-810b-ad9d896d6f57 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:43.775844 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-07a6579f-cc59-4aa2-810b-ad9d896d6f57 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:43.801103 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-07a6579f-cc59-4aa2-810b-ad9d896d6f57 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4] Going to try to terminate instance {{(pid=118314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:34:43.803971 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:34:44.077824 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-07a6579f-cc59-4aa2-810b-ad9d896d6f57 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4" status: 204 len: 0 microversion: 2.1 time: 0.316106 Aug 09 18:34:44.078463 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 572/1167] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:34:43 2022] DELETE /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:34:44.086801 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-320fe80f-402f-4bff-b62f-66763ebbf846 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:44.087416 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-320fe80f-402f-4bff-b62f-66763ebbf846 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:44.089727 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:34:44.094738 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-320fe80f-402f-4bff-b62f-66763ebbf846 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:44.095235 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-320fe80f-402f-4bff-b62f-66763ebbf846 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:44.095675 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-320fe80f-402f-4bff-b62f-66763ebbf846 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:44.096367 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-320fe80f-402f-4bff-b62f-66763ebbf846 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:44.096828 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-320fe80f-402f-4bff-b62f-66763ebbf846 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:44.097259 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-320fe80f-402f-4bff-b62f-66763ebbf846 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:44.101431 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=77 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:34:44.229752 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-320fe80f-402f-4bff-b62f-66763ebbf846 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:44.237362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-320fe80f-402f-4bff-b62f-66763ebbf846 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4" status: 200 len: 1504 microversion: 2.1 time: 0.154653 Aug 09 18:34:44.237923 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 596/1168] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:44 2022] GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:45.259455 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-008c0961-32dc-48e5-a2fb-d2cf3c013dc0 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:45.260145 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-008c0961-32dc-48e5-a2fb-d2cf3c013dc0 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:45.262465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:34:45.267109 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-008c0961-32dc-48e5-a2fb-d2cf3c013dc0 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:45.267622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-008c0961-32dc-48e5-a2fb-d2cf3c013dc0 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:45.268019 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-008c0961-32dc-48e5-a2fb-d2cf3c013dc0 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:45.268699 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-008c0961-32dc-48e5-a2fb-d2cf3c013dc0 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:45.269147 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-008c0961-32dc-48e5-a2fb-d2cf3c013dc0 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:45.269648 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-008c0961-32dc-48e5-a2fb-d2cf3c013dc0 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:45.405735 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-008c0961-32dc-48e5-a2fb-d2cf3c013dc0 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:45.413860 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-008c0961-32dc-48e5-a2fb-d2cf3c013dc0 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4" status: 200 len: 1504 microversion: 2.1 time: 0.158639 Aug 09 18:34:45.414429 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 573/1169] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:45 2022] GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:46.087060 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-c973bd42-d3a1-4c62-a161-3fd95082b3f3 req-ef88fc21-084d-4e9a-96e1-282b1caf65ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3199d6a1-9edb-4d12-9a8c-8dacd569e5a4", "name": "network-vif-deleted", "tag": "562b60d1-ac3b-4002-97fd-9563dc2b4da6"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:34:46.096962 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-c973bd42-d3a1-4c62-a161-3fd95082b3f3 req-ef88fc21-084d-4e9a-96e1-282b1caf65ab service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:46.097626 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-c973bd42-d3a1-4c62-a161-3fd95082b3f3 req-ef88fc21-084d-4e9a-96e1-282b1caf65ab service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:46.098283 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-c973bd42-d3a1-4c62-a161-3fd95082b3f3 req-ef88fc21-084d-4e9a-96e1-282b1caf65ab service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:46.111326 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-c973bd42-d3a1-4c62-a161-3fd95082b3f3 req-ef88fc21-084d-4e9a-96e1-282b1caf65ab service nova] Creating event network-vif-deleted:562b60d1-ac3b-4002-97fd-9563dc2b4da6 for instance 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 on hv-cinder-79797 Aug 09 18:34:46.116615 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-c973bd42-d3a1-4c62-a161-3fd95082b3f3 req-ef88fc21-084d-4e9a-96e1-282b1caf65ab service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034214 Aug 09 18:34:46.117160 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 597/1170] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:34:46.434487 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8c1f57d6-5dd9-4e27-8ee6-ed4e82b0ea2e tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:46.435182 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8c1f57d6-5dd9-4e27-8ee6-ed4e82b0ea2e tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:46.441664 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c1f57d6-5dd9-4e27-8ee6-ed4e82b0ea2e tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:46.442176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c1f57d6-5dd9-4e27-8ee6-ed4e82b0ea2e tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:46.442588 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c1f57d6-5dd9-4e27-8ee6-ed4e82b0ea2e tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:46.443300 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c1f57d6-5dd9-4e27-8ee6-ed4e82b0ea2e tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:46.443747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c1f57d6-5dd9-4e27-8ee6-ed4e82b0ea2e tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:46.444164 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c1f57d6-5dd9-4e27-8ee6-ed4e82b0ea2e tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:46.477133 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c1f57d6-5dd9-4e27-8ee6-ed4e82b0ea2e tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:46.477649 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c1f57d6-5dd9-4e27-8ee6-ed4e82b0ea2e tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:46.478086 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8c1f57d6-5dd9-4e27-8ee6-ed4e82b0ea2e tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:46.478523 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.objects.instance [None req-8c1f57d6-5dd9-4e27-8ee6-ed4e82b0ea2e tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lazy-loading 'fault' on Instance uuid 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 {{(pid=118314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:34:46.522575 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8c1f57d6-5dd9-4e27-8ee6-ed4e82b0ea2e tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32099f8214de4f5caebd0a68efdfb87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f77a082a0324845b34bf0bbb33bc8bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:46.530156 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8c1f57d6-5dd9-4e27-8ee6-ed4e82b0ea2e tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4" status: 200 len: 1304 microversion: 2.1 time: 0.099600 Aug 09 18:34:46.530755 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 574/1171] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:46 2022] GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:47.552335 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a9d78058-1bb4-470a-bac3-05babb92fe90 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:47.553038 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-a9d78058-1bb4-470a-bac3-05babb92fe90 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] [instance: 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:47.559165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a9d78058-1bb4-470a-bac3-05babb92fe90 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:47.559652 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a9d78058-1bb4-470a-bac3-05babb92fe90 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:47.560092 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a9d78058-1bb4-470a-bac3-05babb92fe90 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:47.560781 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a9d78058-1bb4-470a-bac3-05babb92fe90 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:47.561236 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a9d78058-1bb4-470a-bac3-05babb92fe90 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:47.561661 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-a9d78058-1bb4-470a-bac3-05babb92fe90 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:47.575193 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-a9d78058-1bb4-470a-bac3-05babb92fe90 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] HTTP exception thrown: Instance 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 could not be found. Aug 09 18:34:47.576823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a9d78058-1bb4-470a-bac3-05babb92fe90 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Request method failure captured: Aug 09 18:34:47.576823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 HTTP/1.1 Aug 09 18:34:47.576823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:34:47.576823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:34:47.576823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:34:47.576823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:34:47.576823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:34:47.576823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:34:47.576823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:34:47.576823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:34:47.576823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qijwiskVaxG6wYqrNqIzFGTB5WAoyRW8MAt5QBrqeyu9vyW9zljxI8ac8TC8ZTAZbOVOi0sJcQZVLVCQXavyzOChtAiHWq3XbhpGWnmHTM_GD9EvO8KPm8KTay4Gz2rS6lTvIQjwFjbXcogLtKeCRwVlLVVK17MGRMYWInzsdwMVj4 Aug 09 18:34:47.576823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:34:47.576823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:34:47.576823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:34:47.576823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:34:47.576823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:34:47.576823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:34:47.576823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: 4f77a082a0324845b34bf0bbb33bc8bb Aug 09 18:34:47.576823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-VolumesActionsTest-2098598488 Aug 09 18:34:47.576823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:34:47.576823 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:34:47.578525 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4f77a082a0324845b34bf0bbb33bc8bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4f77a082a0324845b34bf0bbb33bc8bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4f77a082a0324845b34bf0bbb33bc8bb", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4f77a082a0324845b34bf0bbb33bc8bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:34:47.578525 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-VolumesActionsTest-2098598488 Aug 09 18:34:47.578525 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: 4f77a082a0324845b34bf0bbb33bc8bb Aug 09 18:34:47.578525 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-VolumesActionsTest-2098598488 Aug 09 18:34:47.578525 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-VolumesActionsTest-2098598488-project Aug 09 18:34:47.578525 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:34:47.578525 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:34:47.578525 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: 32099f8214de4f5caebd0a68efdfb87f Aug 09 18:34:47.578525 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-VolumesActionsTest-2098598488-project Aug 09 18:34:47.578525 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:34:47.578525 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Instance 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 could not be found. Aug 09 18:34:47.578525 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': '3199d6a1-9edb-4d12-9a8c-8dacd569e5a4'} Aug 09 18:34:47.582991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:34:47.582991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:34:47.582991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:34:47.582991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:34:47.582991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:34:47.582991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:34:47.582991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:34:47.582991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:34:47.582991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:34:47.582991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:34:47.582991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 could not be found. Aug 09 18:34:47.582991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:34:47.582991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:34:47.582991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:34:47.582991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:34:47.582991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:34:47.582991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:34:47.582991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:34:47.582991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:34:47.582991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:34:47.584539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:34:47.584539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:34:47.584539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:34:47.584539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:34:47.584539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:34:47.584539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:34:47.584539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:34:47.584539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 could not be found. Aug 09 18:34:47.584539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:34:47.584539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:34:47.584539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:34:47.584539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:34:47.584539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:34:47.584539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:34:47.584539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:34:47.584539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:34:47.584539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 could not be found. Aug 09 18:34:47.584539 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:34:47.585749 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-a9d78058-1bb4-470a-bac3-05babb92fe90 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] Returning 404 to user: Instance 3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:34:47.585749 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-a9d78058-1bb4-470a-bac3-05babb92fe90 tempest-VolumesActionsTest-2098598488 tempest-VolumesActionsTest-2098598488-project] 10.222.0.36 "GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4" status: 404 len: 111 microversion: 2.1 time: 0.030706 Aug 09 18:34:47.585749 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 598/1172] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:47 2022] GET /compute/v2.1/servers/3199d6a1-9edb-4d12-9a8c-8dacd569e5a4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:35:27.882764 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=5 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:35:27.888308 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:35:28.069651 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-ccec613d-35ee-4049-8ea4-3937275c7414 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Action: 'create', calling method: .version_select at 0x7f4c351ccee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1200008127", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+KfL4vYWRDVY+vjShEI61Sb34/WDhTifO07+87ituHQauAA5pInbTAqbd++BH8eqs7wxKOEQChFAUCDWDnkGXTrB0kSn8aQIxem0rO3pa1Huc/osrMDGgwzL84z1fSdQ=="}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:35:28.086320 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-ccec613d-35ee-4049-8ea4-3937275c7414 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Getting quotas for project 13bae50787744ee98e555d0db03e7c0e. Resources: {'key_pairs'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:35:28.090467 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-ccec613d-35ee-4049-8ea4-3937275c7414 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Getting quotas for user ac1260c6ff5943f4b4e86ea91f232452 and project 13bae50787744ee98e555d0db03e7c0e. Resources: {'key_pairs'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:35:28.181454 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-ccec613d-35ee-4049-8ea4-3937275c7414 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.303560 Aug 09 18:35:28.187276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 575/1173] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Aug 9 18:35:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:35:52.768856 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=5 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:35:52.769695 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=9 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:35:52.773716 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-ad5b499e-82d2-4e0b-a0f9-b58b46d0fd4a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-702354171", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1200008127", "security_groups": [{"name": "tempest-secgroup-smoke-1192013142"}], "block_device_mapping_v2": [{"uuid": "96d818e9-d760-4544-940c-bc881d91b404", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b1a0050c-ff5d-4596-bb88-875e50e53328"}]}} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:35:52.987169 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.network.neutron [None req-ad5b499e-82d2-4e0b-a0f9-b58b46d0fd4a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] validate_networks() for [('b1a0050c-ff5d-4596-bb88-875e50e53328', None, None, None, None, None)] {{(pid=118313) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:35:53.352388 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-ad5b499e-82d2-4e0b-a0f9-b58b46d0fd4a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Flavor limits 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:35:53.352815 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-ad5b499e-82d2-4e0b-a0f9-b58b46d0fd4a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Image limits 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:35:53.353291 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-ad5b499e-82d2-4e0b-a0f9-b58b46d0fd4a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Flavor pref 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:35:53.353703 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-ad5b499e-82d2-4e0b-a0f9-b58b46d0fd4a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Image pref 0:0:0 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:35:53.354114 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.virt.hardware [None req-ad5b499e-82d2-4e0b-a0f9-b58b46d0fd4a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:35:53.362948 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ad5b499e-82d2-4e0b-a0f9-b58b46d0fd4a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:35:53.363435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ad5b499e-82d2-4e0b-a0f9-b58b46d0fd4a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:35:53.363872 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ad5b499e-82d2-4e0b-a0f9-b58b46d0fd4a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:35:53.364602 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ad5b499e-82d2-4e0b-a0f9-b58b46d0fd4a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:35:53.365061 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ad5b499e-82d2-4e0b-a0f9-b58b46d0fd4a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:35:53.365491 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ad5b499e-82d2-4e0b-a0f9-b58b46d0fd4a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:35:53.382926 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-ad5b499e-82d2-4e0b-a0f9-b58b46d0fd4a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Getting quotas for project 13bae50787744ee98e555d0db03e7c0e. Resources: {'cores', 'instances', 'ram'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:35:53.386857 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.quota [None req-ad5b499e-82d2-4e0b-a0f9-b58b46d0fd4a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Getting quotas for user ac1260c6ff5943f4b4e86ea91f232452 and project 13bae50787744ee98e555d0db03e7c0e. Resources: {'cores', 'instances', 'ram'} {{(pid=118313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:35:53.443879 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-ad5b499e-82d2-4e0b-a0f9-b58b46d0fd4a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Going to run 1 instances... {{(pid=118313) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:35:53.445949 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-ad5b499e-82d2-4e0b-a0f9-b58b46d0fd4a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='96d818e9-d760-4544-940c-bc881d91b404',volume_size=None,volume_type=None)] {{(pid=118313) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:35:53.821538 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-ad5b499e-82d2-4e0b-a0f9-b58b46d0fd4a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.054549 Aug 09 18:35:53.822254 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 599/1174] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Aug 9 18:35:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:35:53.830950 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=4 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:35:53.831904 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:35:53.835830 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8f28ee44-95dc-4e8e-8bda-d8c810d4d7b0 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:35:53.836734 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8f28ee44-95dc-4e8e-8bda-d8c810d4d7b0 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:35:53.999925 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8f28ee44-95dc-4e8e-8bda-d8c810d4d7b0 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:35:54.008167 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8f28ee44-95dc-4e8e-8bda-d8c810d4d7b0 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 200 len: 1094 microversion: 2.1 time: 0.178673 Aug 09 18:35:54.008729 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 576/1175] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:35:53 2022] GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 1094 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:35:55.028709 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-dcf3d68a-d40e-4fc7-84e3-7145b56bd492 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:35:55.029404 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-dcf3d68a-d40e-4fc7-84e3-7145b56bd492 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:35:55.036953 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dcf3d68a-d40e-4fc7-84e3-7145b56bd492 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:35:55.037435 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dcf3d68a-d40e-4fc7-84e3-7145b56bd492 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:35:55.037898 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dcf3d68a-d40e-4fc7-84e3-7145b56bd492 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:35:55.038640 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dcf3d68a-d40e-4fc7-84e3-7145b56bd492 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:35:55.039123 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dcf3d68a-d40e-4fc7-84e3-7145b56bd492 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:35:55.039544 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-dcf3d68a-d40e-4fc7-84e3-7145b56bd492 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:35:55.099386 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-dcf3d68a-d40e-4fc7-84e3-7145b56bd492 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:35:55.106909 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-dcf3d68a-d40e-4fc7-84e3-7145b56bd492 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 200 len: 1144 microversion: 2.1 time: 0.082119 Aug 09 18:35:55.108194 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 600/1176] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:35:55 2022] GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:35:56.129083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c48497c1-bbea-49bc-b9fd-c5a6ff58b773 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:35:56.129725 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c48497c1-bbea-49bc-b9fd-c5a6ff58b773 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:35:56.136066 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c48497c1-bbea-49bc-b9fd-c5a6ff58b773 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:35:56.136554 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c48497c1-bbea-49bc-b9fd-c5a6ff58b773 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:35:56.137211 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c48497c1-bbea-49bc-b9fd-c5a6ff58b773 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:35:56.138087 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c48497c1-bbea-49bc-b9fd-c5a6ff58b773 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:35:56.138730 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c48497c1-bbea-49bc-b9fd-c5a6ff58b773 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:35:56.139296 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c48497c1-bbea-49bc-b9fd-c5a6ff58b773 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:35:56.219346 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c48497c1-bbea-49bc-b9fd-c5a6ff58b773 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:35:56.227065 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c48497c1-bbea-49bc-b9fd-c5a6ff58b773 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 200 len: 1200 microversion: 2.1 time: 0.102322 Aug 09 18:35:56.232837 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 577/1177] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:35:56 2022] GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 1200 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:35:57.247778 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c653a9b9-7b1a-4c7f-ad0c-0e1548c578d4 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:35:57.248513 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-c653a9b9-7b1a-4c7f-ad0c-0e1548c578d4 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:35:57.255743 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c653a9b9-7b1a-4c7f-ad0c-0e1548c578d4 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:35:57.256803 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c653a9b9-7b1a-4c7f-ad0c-0e1548c578d4 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:35:57.256803 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c653a9b9-7b1a-4c7f-ad0c-0e1548c578d4 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:35:57.257493 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c653a9b9-7b1a-4c7f-ad0c-0e1548c578d4 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:35:57.257957 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c653a9b9-7b1a-4c7f-ad0c-0e1548c578d4 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:35:57.258381 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c653a9b9-7b1a-4c7f-ad0c-0e1548c578d4 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:35:57.455376 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:35:57.455625 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Tue Aug 9 18:35:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 (ip 10.222.0.36) !!! Aug 09 18:35:57.463011 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-c653a9b9-7b1a-4c7f-ad0c-0e1548c578d4 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:35:57.472442 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-c653a9b9-7b1a-4c7f-ad0c-0e1548c578d4 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 200 len: 1278 microversion: 2.1 time: 0.228591 Aug 09 18:35:57.473474 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 601/1178] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:35:57 2022] GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 1278 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:35:57.826285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-e6f48404-f071-4f94-8536-91c5e03f1c80 req-e1883bb1-df4e-44a0-a6a6-d879667c7c3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fd2e961-f88f-40b8-be45-f7b189058554", "tag": "f4a082ea-26bc-41cf-971d-06b006f056ed"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:35:57.837765 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-e6f48404-f071-4f94-8536-91c5e03f1c80 req-e1883bb1-df4e-44a0-a6a6-d879667c7c3d service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:35:57.838239 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-e6f48404-f071-4f94-8536-91c5e03f1c80 req-e1883bb1-df4e-44a0-a6a6-d879667c7c3d service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:35:57.838669 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-e6f48404-f071-4f94-8536-91c5e03f1c80 req-e1883bb1-df4e-44a0-a6a6-d879667c7c3d service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:35:57.851561 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-e6f48404-f071-4f94-8536-91c5e03f1c80 req-e1883bb1-df4e-44a0-a6a6-d879667c7c3d service nova] Creating event network-changed:f4a082ea-26bc-41cf-971d-06b006f056ed for instance 7fd2e961-f88f-40b8-be45-f7b189058554 on hv-cinder-79797 Aug 09 18:35:57.856645 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-e6f48404-f071-4f94-8536-91c5e03f1c80 req-e1883bb1-df4e-44a0-a6a6-d879667c7c3d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034009 Aug 09 18:35:57.857235 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 578/1179] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:35:58.493671 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e175a40e-f2d3-4ed0-99b1-8b5284e6e993 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:35:58.494392 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e175a40e-f2d3-4ed0-99b1-8b5284e6e993 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:35:58.501848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e175a40e-f2d3-4ed0-99b1-8b5284e6e993 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:35:58.502393 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e175a40e-f2d3-4ed0-99b1-8b5284e6e993 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:35:58.502861 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e175a40e-f2d3-4ed0-99b1-8b5284e6e993 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:35:58.503570 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e175a40e-f2d3-4ed0-99b1-8b5284e6e993 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:35:58.504021 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e175a40e-f2d3-4ed0-99b1-8b5284e6e993 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:35:58.504446 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e175a40e-f2d3-4ed0-99b1-8b5284e6e993 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:35:58.635320 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e175a40e-f2d3-4ed0-99b1-8b5284e6e993 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:35:58.643117 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e175a40e-f2d3-4ed0-99b1-8b5284e6e993 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 200 len: 1266 microversion: 2.1 time: 0.153374 Aug 09 18:35:58.645687 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 602/1180] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:35:58 2022] GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:35:59.665488 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-d6179b0c-cfc0-43dd-9804-850f7b47e666 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:35:59.666174 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-d6179b0c-cfc0-43dd-9804-850f7b47e666 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:35:59.673666 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d6179b0c-cfc0-43dd-9804-850f7b47e666 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:35:59.674146 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d6179b0c-cfc0-43dd-9804-850f7b47e666 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:35:59.674581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d6179b0c-cfc0-43dd-9804-850f7b47e666 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:35:59.675285 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d6179b0c-cfc0-43dd-9804-850f7b47e666 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:35:59.675736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d6179b0c-cfc0-43dd-9804-850f7b47e666 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:35:59.676154 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-d6179b0c-cfc0-43dd-9804-850f7b47e666 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:35:59.813436 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-d6179b0c-cfc0-43dd-9804-850f7b47e666 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:35:59.820979 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-d6179b0c-cfc0-43dd-9804-850f7b47e666 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 200 len: 1266 microversion: 2.1 time: 0.159686 Aug 09 18:35:59.821554 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 579/1181] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:35:59 2022] GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:36:00.841643 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b56a883e-0eb3-49f2-b3dd-9746e6a0389a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:36:00.842287 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-b56a883e-0eb3-49f2-b3dd-9746e6a0389a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:36:00.849359 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b56a883e-0eb3-49f2-b3dd-9746e6a0389a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:00.849840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b56a883e-0eb3-49f2-b3dd-9746e6a0389a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:00.850271 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b56a883e-0eb3-49f2-b3dd-9746e6a0389a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:00.850980 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b56a883e-0eb3-49f2-b3dd-9746e6a0389a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:00.851431 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b56a883e-0eb3-49f2-b3dd-9746e6a0389a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:00.851851 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b56a883e-0eb3-49f2-b3dd-9746e6a0389a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:00.979408 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b56a883e-0eb3-49f2-b3dd-9746e6a0389a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:36:00.987100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b56a883e-0eb3-49f2-b3dd-9746e6a0389a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 200 len: 1266 microversion: 2.1 time: 0.149441 Aug 09 18:36:00.987664 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 603/1182] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:36:00 2022] GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:36:02.008094 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c00d87c8-4720-4b41-be6c-11ef1a7e4f2b tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:36:02.008702 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c00d87c8-4720-4b41-be6c-11ef1a7e4f2b tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:36:02.015623 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c00d87c8-4720-4b41-be6c-11ef1a7e4f2b tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:02.016105 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c00d87c8-4720-4b41-be6c-11ef1a7e4f2b tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:02.016538 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c00d87c8-4720-4b41-be6c-11ef1a7e4f2b tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:02.017227 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c00d87c8-4720-4b41-be6c-11ef1a7e4f2b tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:02.017679 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c00d87c8-4720-4b41-be6c-11ef1a7e4f2b tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:02.018102 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c00d87c8-4720-4b41-be6c-11ef1a7e4f2b tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:02.156680 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c00d87c8-4720-4b41-be6c-11ef1a7e4f2b tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:36:02.164132 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c00d87c8-4720-4b41-be6c-11ef1a7e4f2b tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 200 len: 1266 microversion: 2.1 time: 0.159937 Aug 09 18:36:02.164697 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 580/1183] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:36:02 2022] GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:36:03.185356 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-2c2f7f76-0413-4d55-b8fc-c143248b6afc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:36:03.185909 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-2c2f7f76-0413-4d55-b8fc-c143248b6afc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:36:03.192812 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2c2f7f76-0413-4d55-b8fc-c143248b6afc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:03.193293 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2c2f7f76-0413-4d55-b8fc-c143248b6afc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:03.193737 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2c2f7f76-0413-4d55-b8fc-c143248b6afc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:03.194413 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2c2f7f76-0413-4d55-b8fc-c143248b6afc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:03.194955 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2c2f7f76-0413-4d55-b8fc-c143248b6afc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:03.195373 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-2c2f7f76-0413-4d55-b8fc-c143248b6afc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:03.325022 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-2c2f7f76-0413-4d55-b8fc-c143248b6afc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:36:03.333052 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-2c2f7f76-0413-4d55-b8fc-c143248b6afc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 200 len: 1266 microversion: 2.1 time: 0.151600 Aug 09 18:36:03.333613 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 604/1184] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:36:03 2022] GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:36:04.353736 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-23646778-5b92-420e-b3ef-2d98ffc11945 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:36:04.354346 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-23646778-5b92-420e-b3ef-2d98ffc11945 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:36:04.356770 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=2 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:36:04.361680 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-23646778-5b92-420e-b3ef-2d98ffc11945 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:04.362159 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-23646778-5b92-420e-b3ef-2d98ffc11945 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:04.365954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-23646778-5b92-420e-b3ef-2d98ffc11945 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:04.365954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-23646778-5b92-420e-b3ef-2d98ffc11945 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:04.365954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-23646778-5b92-420e-b3ef-2d98ffc11945 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:04.365954 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-23646778-5b92-420e-b3ef-2d98ffc11945 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:04.498792 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-23646778-5b92-420e-b3ef-2d98ffc11945 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:36:04.506530 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-23646778-5b92-420e-b3ef-2d98ffc11945 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 200 len: 1266 microversion: 2.1 time: 0.156777 Aug 09 18:36:04.507132 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 581/1185] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:36:04 2022] GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:36:05.527069 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-911c5506-9755-4850-b9e4-8ea66e577633 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:36:05.527676 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-911c5506-9755-4850-b9e4-8ea66e577633 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:36:05.529474 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=2 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:36:05.530170 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=6 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:36:05.535710 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-911c5506-9755-4850-b9e4-8ea66e577633 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:05.541984 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-911c5506-9755-4850-b9e4-8ea66e577633 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:05.541984 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-911c5506-9755-4850-b9e4-8ea66e577633 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:05.541984 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-911c5506-9755-4850-b9e4-8ea66e577633 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:05.541984 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-911c5506-9755-4850-b9e4-8ea66e577633 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:05.542379 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-911c5506-9755-4850-b9e4-8ea66e577633 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:05.666267 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-911c5506-9755-4850-b9e4-8ea66e577633 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:36:05.674258 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-911c5506-9755-4850-b9e4-8ea66e577633 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 200 len: 1266 microversion: 2.1 time: 0.151171 Aug 09 18:36:05.674843 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 605/1186] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:36:05 2022] GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:36:06.694022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8e9031a3-3bd1-4844-b84e-da658b06f7a5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:36:06.694658 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8e9031a3-3bd1-4844-b84e-da658b06f7a5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:36:06.701121 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e9031a3-3bd1-4844-b84e-da658b06f7a5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:06.701604 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e9031a3-3bd1-4844-b84e-da658b06f7a5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:06.702043 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e9031a3-3bd1-4844-b84e-da658b06f7a5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:06.702921 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e9031a3-3bd1-4844-b84e-da658b06f7a5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:06.703377 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e9031a3-3bd1-4844-b84e-da658b06f7a5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:06.703810 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8e9031a3-3bd1-4844-b84e-da658b06f7a5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:06.835716 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8e9031a3-3bd1-4844-b84e-da658b06f7a5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:36:06.843616 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8e9031a3-3bd1-4844-b84e-da658b06f7a5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 200 len: 1266 microversion: 2.1 time: 0.153552 Aug 09 18:36:06.844441 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 582/1187] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:36:06 2022] GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:36:07.864465 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-961d0b16-545f-425d-b425-0fb0d72061d9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:36:07.865059 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-961d0b16-545f-425d-b425-0fb0d72061d9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:36:07.871477 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-961d0b16-545f-425d-b425-0fb0d72061d9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:07.871955 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-961d0b16-545f-425d-b425-0fb0d72061d9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:07.872385 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-961d0b16-545f-425d-b425-0fb0d72061d9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:07.873124 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-961d0b16-545f-425d-b425-0fb0d72061d9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:07.873579 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-961d0b16-545f-425d-b425-0fb0d72061d9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:07.874540 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-961d0b16-545f-425d-b425-0fb0d72061d9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:08.008008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-961d0b16-545f-425d-b425-0fb0d72061d9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:36:08.016014 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-961d0b16-545f-425d-b425-0fb0d72061d9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 200 len: 1266 microversion: 2.1 time: 0.155411 Aug 09 18:36:08.016576 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 606/1188] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:36:07 2022] GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:36:09.037399 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f9fbdccd-f6e7-444b-8212-a31258d9efe5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:36:09.038202 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f9fbdccd-f6e7-444b-8212-a31258d9efe5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:36:09.044464 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f9fbdccd-f6e7-444b-8212-a31258d9efe5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:09.050068 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f9fbdccd-f6e7-444b-8212-a31258d9efe5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:09.050068 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f9fbdccd-f6e7-444b-8212-a31258d9efe5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:09.050068 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f9fbdccd-f6e7-444b-8212-a31258d9efe5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:09.050068 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f9fbdccd-f6e7-444b-8212-a31258d9efe5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:09.050461 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f9fbdccd-f6e7-444b-8212-a31258d9efe5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:09.050546 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-bdaf826b-cb0a-458a-995e-fa20a808c87e req-53d89215-ae7b-42b2-becf-e5d2593f7ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fd2e961-f88f-40b8-be45-f7b189058554", "name": "network-vif-plugged", "status": "completed", "tag": "f4a082ea-26bc-41cf-971d-06b006f056ed"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:36:09.059565 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-bdaf826b-cb0a-458a-995e-fa20a808c87e req-53d89215-ae7b-42b2-becf-e5d2593f7ef6 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:09.060096 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-bdaf826b-cb0a-458a-995e-fa20a808c87e req-53d89215-ae7b-42b2-becf-e5d2593f7ef6 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:09.060521 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-bdaf826b-cb0a-458a-995e-fa20a808c87e req-53d89215-ae7b-42b2-becf-e5d2593f7ef6 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:09.072394 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-bdaf826b-cb0a-458a-995e-fa20a808c87e req-53d89215-ae7b-42b2-becf-e5d2593f7ef6 service nova] Creating event network-vif-plugged:f4a082ea-26bc-41cf-971d-06b006f056ed for instance 7fd2e961-f88f-40b8-be45-f7b189058554 on hv-cinder-79797 Aug 09 18:36:09.077467 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-bdaf826b-cb0a-458a-995e-fa20a808c87e req-53d89215-ae7b-42b2-becf-e5d2593f7ef6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032401 Aug 09 18:36:09.078054 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 607/1189] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:36:09.191254 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f9fbdccd-f6e7-444b-8212-a31258d9efe5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:36:09.199074 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f9fbdccd-f6e7-444b-8212-a31258d9efe5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 200 len: 1266 microversion: 2.1 time: 0.165604 Aug 09 18:36:09.199639 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 583/1190] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:36:09 2022] GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:36:10.221560 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-6f928e89-86b9-447c-9bb3-010ed14292b0 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:36:10.222167 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-6f928e89-86b9-447c-9bb3-010ed14292b0 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:36:10.228275 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6f928e89-86b9-447c-9bb3-010ed14292b0 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:10.228755 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6f928e89-86b9-447c-9bb3-010ed14292b0 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:10.229182 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6f928e89-86b9-447c-9bb3-010ed14292b0 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:10.229860 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6f928e89-86b9-447c-9bb3-010ed14292b0 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:10.230310 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6f928e89-86b9-447c-9bb3-010ed14292b0 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:10.230750 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-6f928e89-86b9-447c-9bb3-010ed14292b0 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:10.359295 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-6f928e89-86b9-447c-9bb3-010ed14292b0 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:36:10.366825 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-6f928e89-86b9-447c-9bb3-010ed14292b0 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 200 len: 1266 microversion: 2.1 time: 0.150039 Aug 09 18:36:10.367384 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 608/1191] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:36:10 2022] GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:36:11.387813 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-2610300c-fde0-4f47-aa88-57f4446b26f3 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:36:11.388414 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-2610300c-fde0-4f47-aa88-57f4446b26f3 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:36:11.395014 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2610300c-fde0-4f47-aa88-57f4446b26f3 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:11.395492 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2610300c-fde0-4f47-aa88-57f4446b26f3 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:11.395955 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2610300c-fde0-4f47-aa88-57f4446b26f3 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:11.396643 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2610300c-fde0-4f47-aa88-57f4446b26f3 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:11.397093 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2610300c-fde0-4f47-aa88-57f4446b26f3 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:11.397518 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2610300c-fde0-4f47-aa88-57f4446b26f3 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:11.527747 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-2610300c-fde0-4f47-aa88-57f4446b26f3 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:36:11.535758 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-2610300c-fde0-4f47-aa88-57f4446b26f3 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 200 len: 1454 microversion: 2.1 time: 0.151839 Aug 09 18:36:11.536320 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 584/1192] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:36:11 2022] GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:36:11.556139 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5245f879-d26b-4da4-a90d-7c73fb692621 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:36:11.556750 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-5245f879-d26b-4da4-a90d-7c73fb692621 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:36:11.563345 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5245f879-d26b-4da4-a90d-7c73fb692621 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:11.563848 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5245f879-d26b-4da4-a90d-7c73fb692621 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:11.564329 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5245f879-d26b-4da4-a90d-7c73fb692621 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:11.565025 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5245f879-d26b-4da4-a90d-7c73fb692621 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:11.565514 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5245f879-d26b-4da4-a90d-7c73fb692621 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:11.565949 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5245f879-d26b-4da4-a90d-7c73fb692621 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:11.698028 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-5245f879-d26b-4da4-a90d-7c73fb692621 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:36:11.705609 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-5245f879-d26b-4da4-a90d-7c73fb692621 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 200 len: 1454 microversion: 2.1 time: 0.153355 Aug 09 18:36:11.706186 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 609/1193] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:36:11 2022] GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:36:13.928067 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-7587c3df-153f-4689-b68c-25e6ef241281 req-078d4752-c4d6-4413-9e7b-d44c52a404b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fd2e961-f88f-40b8-be45-f7b189058554", "tag": "f4a082ea-26bc-41cf-971d-06b006f056ed"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:36:13.938209 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-7587c3df-153f-4689-b68c-25e6ef241281 req-078d4752-c4d6-4413-9e7b-d44c52a404b6 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:13.938680 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-7587c3df-153f-4689-b68c-25e6ef241281 req-078d4752-c4d6-4413-9e7b-d44c52a404b6 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:13.944156 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-7587c3df-153f-4689-b68c-25e6ef241281 req-078d4752-c4d6-4413-9e7b-d44c52a404b6 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:13.950451 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-7587c3df-153f-4689-b68c-25e6ef241281 req-078d4752-c4d6-4413-9e7b-d44c52a404b6 service nova] Creating event network-changed:f4a082ea-26bc-41cf-971d-06b006f056ed for instance 7fd2e961-f88f-40b8-be45-f7b189058554 on hv-cinder-79797 Aug 09 18:36:13.956351 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-7587c3df-153f-4689-b68c-25e6ef241281 req-078d4752-c4d6-4413-9e7b-d44c52a404b6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032004 Aug 09 18:36:13.957157 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 585/1194] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:37:19.831469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:37:19.832164 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Tue Aug 9 18:37:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:38:27.788790 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:38:27.789547 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=58 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:38:27.793420 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-ec831845-869e-4464-b8c1-a5fd6f8913cb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:27.793915 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-ec831845-869e-4464-b8c1-a5fd6f8913cb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:27.800296 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ec831845-869e-4464-b8c1-a5fd6f8913cb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:27.800830 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ec831845-869e-4464-b8c1-a5fd6f8913cb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:27.801261 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ec831845-869e-4464-b8c1-a5fd6f8913cb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:27.801954 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ec831845-869e-4464-b8c1-a5fd6f8913cb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:27.802413 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ec831845-869e-4464-b8c1-a5fd6f8913cb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:27.802951 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-ec831845-869e-4464-b8c1-a5fd6f8913cb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:27.827412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-ec831845-869e-4464-b8c1-a5fd6f8913cb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Going to try to terminate instance {{(pid=118313) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:38:28.125758 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-ec831845-869e-4464-b8c1-a5fd6f8913cb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 204 len: 0 microversion: 2.1 time: 0.338558 Aug 09 18:38:28.126289 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 610/1195] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:38:27 2022] DELETE /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:38:28.134074 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR oslo.messaging._drivers.impl_rabbit [-] [42b217cc-ff29-433a-b80f-cb3775aa45c0] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 18:38:28.134596 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=22 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:38:28.135253 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=46 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:38:28.141865 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-aec1c9be-7163-4373-a80a-24b50d4da786 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:28.142555 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-aec1c9be-7163-4373-a80a-24b50d4da786 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:28.148739 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aec1c9be-7163-4373-a80a-24b50d4da786 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:28.150993 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aec1c9be-7163-4373-a80a-24b50d4da786 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:28.150993 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aec1c9be-7163-4373-a80a-24b50d4da786 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:28.150993 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aec1c9be-7163-4373-a80a-24b50d4da786 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:28.150993 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aec1c9be-7163-4373-a80a-24b50d4da786 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:28.151425 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-aec1c9be-7163-4373-a80a-24b50d4da786 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:28.299581 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-aec1c9be-7163-4373-a80a-24b50d4da786 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:28.308153 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-aec1c9be-7163-4373-a80a-24b50d4da786 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 200 len: 1579 microversion: 2.1 time: 0.177381 Aug 09 18:38:28.308723 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 586/1196] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:28 2022] GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 1579 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:38:29.331484 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-fda61d26-a285-4f74-a45f-f72d1ff26abc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:29.332161 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-fda61d26-a285-4f74-a45f-f72d1ff26abc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:29.338932 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fda61d26-a285-4f74-a45f-f72d1ff26abc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:29.339416 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fda61d26-a285-4f74-a45f-f72d1ff26abc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:29.339853 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fda61d26-a285-4f74-a45f-f72d1ff26abc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:29.340537 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fda61d26-a285-4f74-a45f-f72d1ff26abc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:29.341013 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fda61d26-a285-4f74-a45f-f72d1ff26abc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:29.341412 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-fda61d26-a285-4f74-a45f-f72d1ff26abc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:29.481081 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-fda61d26-a285-4f74-a45f-f72d1ff26abc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:29.489081 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-fda61d26-a285-4f74-a45f-f72d1ff26abc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 200 len: 1579 microversion: 2.1 time: 0.162436 Aug 09 18:38:29.490061 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 611/1197] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:29 2022] GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 1579 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:38:30.511575 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-3e06a473-2cdb-4aa6-a500-9215673c1c68 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:30.512184 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-3e06a473-2cdb-4aa6-a500-9215673c1c68 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:30.522262 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3e06a473-2cdb-4aa6-a500-9215673c1c68 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:30.522781 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3e06a473-2cdb-4aa6-a500-9215673c1c68 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:30.523224 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3e06a473-2cdb-4aa6-a500-9215673c1c68 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:30.523923 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3e06a473-2cdb-4aa6-a500-9215673c1c68 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:30.524375 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3e06a473-2cdb-4aa6-a500-9215673c1c68 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:30.524796 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3e06a473-2cdb-4aa6-a500-9215673c1c68 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:30.530239 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO oslo.messaging._drivers.impl_rabbit [-] [42b217cc-ff29-433a-b80f-cb3775aa45c0] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 35436. Aug 09 18:38:30.623885 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-3e06a473-2cdb-4aa6-a500-9215673c1c68 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:30.631745 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-3e06a473-2cdb-4aa6-a500-9215673c1c68 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 200 len: 1511 microversion: 2.1 time: 0.124130 Aug 09 18:38:30.632317 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 587/1198] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:30 2022] GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 1511 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:38:30.806039 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-bf55fba1-b990-49a0-90bb-34463fdc83e8 req-7a806276-98de-4da0-af69-897143d6af6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fd2e961-f88f-40b8-be45-f7b189058554", "name": "network-vif-deleted", "tag": "f4a082ea-26bc-41cf-971d-06b006f056ed"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:38:30.818179 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-bf55fba1-b990-49a0-90bb-34463fdc83e8 req-7a806276-98de-4da0-af69-897143d6af6f service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:30.818661 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-bf55fba1-b990-49a0-90bb-34463fdc83e8 req-7a806276-98de-4da0-af69-897143d6af6f service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:30.819131 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-bf55fba1-b990-49a0-90bb-34463fdc83e8 req-7a806276-98de-4da0-af69-897143d6af6f service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:30.831657 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-bf55fba1-b990-49a0-90bb-34463fdc83e8 req-7a806276-98de-4da0-af69-897143d6af6f service nova] Creating event network-vif-deleted:f4a082ea-26bc-41cf-971d-06b006f056ed for instance 7fd2e961-f88f-40b8-be45-f7b189058554 on hv-cinder-79797 Aug 09 18:38:30.838438 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-bf55fba1-b990-49a0-90bb-34463fdc83e8 req-7a806276-98de-4da0-af69-897143d6af6f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104129 Aug 09 18:38:30.839716 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 612/1199] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:38:31.653469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-823e7294-11cb-444b-942d-0d0948f85be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:31.654198 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-823e7294-11cb-444b-942d-0d0948f85be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:31.661934 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-823e7294-11cb-444b-942d-0d0948f85be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:31.667633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-823e7294-11cb-444b-942d-0d0948f85be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:31.667633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-823e7294-11cb-444b-942d-0d0948f85be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:31.667633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-823e7294-11cb-444b-942d-0d0948f85be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:31.667633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-823e7294-11cb-444b-942d-0d0948f85be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:31.668070 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-823e7294-11cb-444b-942d-0d0948f85be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:31.695833 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-823e7294-11cb-444b-942d-0d0948f85be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:31.696308 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-823e7294-11cb-444b-942d-0d0948f85be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:31.696737 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-823e7294-11cb-444b-942d-0d0948f85be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:31.697173 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.objects.instance [None req-823e7294-11cb-444b-942d-0d0948f85be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lazy-loading 'fault' on Instance uuid 7fd2e961-f88f-40b8-be45-f7b189058554 {{(pid=118314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:38:31.739418 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-823e7294-11cb-444b-942d-0d0948f85be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:31.747024 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-823e7294-11cb-444b-942d-0d0948f85be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 200 len: 1230 microversion: 2.1 time: 0.097579 Aug 09 18:38:31.747597 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 588/1200] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:31 2022] GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:38:32.773735 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5de36cd5-98cd-45e0-80b3-4bd4034352fc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:32.774434 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-5de36cd5-98cd-45e0-80b3-4bd4034352fc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:32.780646 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5de36cd5-98cd-45e0-80b3-4bd4034352fc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:32.785431 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5de36cd5-98cd-45e0-80b3-4bd4034352fc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:32.785431 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5de36cd5-98cd-45e0-80b3-4bd4034352fc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:32.785431 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5de36cd5-98cd-45e0-80b3-4bd4034352fc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:32.785431 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5de36cd5-98cd-45e0-80b3-4bd4034352fc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:32.785858 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5de36cd5-98cd-45e0-80b3-4bd4034352fc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:32.797081 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-5de36cd5-98cd-45e0-80b3-4bd4034352fc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] HTTP exception thrown: Instance 7fd2e961-f88f-40b8-be45-f7b189058554 could not be found. Aug 09 18:38:32.798728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5de36cd5-98cd-45e0-80b3-4bd4034352fc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Request method failure captured: Aug 09 18:38:32.798728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 HTTP/1.1 Aug 09 18:38:32.798728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:38:32.798728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:38:32.798728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:38:32.798728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:38:32.798728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:38:32.798728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:38:32.798728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:38:32.798728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:38:32.798728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qjpVf2G6OSFd2VDo-TBiVPtNxpDTeDPD_pxAeW4XKslDy0TsUsdGNi3opVFcwG8_nlQ_MV73l8DflSeZFyKx7itf9f-QBTMRmzT0EqL6MkAI28RudwwrzEXgjbvshP1pJa8SEiXzaEZi6-30vBSWJzH-6RYFhgIzGVq20wdVhFS8HA Aug 09 18:38:32.798728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:38:32.798728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:38:32.798728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:38:32.798728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:38:32.798728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:38:32.798728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:38:32.798728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: 13bae50787744ee98e555d0db03e7c0e Aug 09 18:38:32.798728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-TestVolumeBootPattern-912954134 Aug 09 18:38:32.798728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:38:32.798728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:38:32.800532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13bae50787744ee98e555d0db03e7c0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/13bae50787744ee98e555d0db03e7c0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_13bae50787744ee98e555d0db03e7c0e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13bae50787744ee98e555d0db03e7c0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:38:32.800532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-TestVolumeBootPattern-912954134 Aug 09 18:38:32.800532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: 13bae50787744ee98e555d0db03e7c0e Aug 09 18:38:32.800532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-TestVolumeBootPattern-912954134 Aug 09 18:38:32.800532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-TestVolumeBootPattern-912954134-project Aug 09 18:38:32.800532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:38:32.800532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:38:32.800532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: ac1260c6ff5943f4b4e86ea91f232452 Aug 09 18:38:32.800532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-TestVolumeBootPattern-912954134-project Aug 09 18:38:32.800532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:38:32.800532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Instance 7fd2e961-f88f-40b8-be45-f7b189058554 could not be found. Aug 09 18:38:32.800532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': '7fd2e961-f88f-40b8-be45-f7b189058554'} Aug 09 18:38:32.801588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:38:32.801588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:38:32.801588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:38:32.801588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:38:32.801588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:38:32.801588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:38:32.801588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:38:32.801588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:38:32.801588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:38:32.801588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:38:32.801588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fd2e961-f88f-40b8-be45-f7b189058554 could not be found. Aug 09 18:38:32.801588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:38:32.801588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:38:32.801588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:38:32.801588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:38:32.801588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:38:32.801588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:38:32.801588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:38:32.801588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:38:32.801588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:38:32.803321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:38:32.803321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:38:32.803321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:38:32.803321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:38:32.803321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:38:32.803321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:38:32.803321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:38:32.803321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fd2e961-f88f-40b8-be45-f7b189058554 could not be found. Aug 09 18:38:32.803321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:38:32.803321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:38:32.803321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:38:32.803321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:38:32.803321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:38:32.803321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:38:32.803321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:38:32.803321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:38:32.803321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fd2e961-f88f-40b8-be45-f7b189058554 could not be found. Aug 09 18:38:32.803321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:38:32.804855 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5de36cd5-98cd-45e0-80b3-4bd4034352fc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Returning 404 to user: Instance 7fd2e961-f88f-40b8-be45-f7b189058554 could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:38:32.804855 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-5de36cd5-98cd-45e0-80b3-4bd4034352fc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 404 len: 111 microversion: 2.1 time: 0.031160 Aug 09 18:38:32.804855 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 613/1201] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:32 2022] GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:38:32.849271 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-9800fb17-2f78-467a-9a51-ae003ff63606 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-807351428", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1200008127", "security_groups": [{"name": "tempest-secgroup-smoke-1192013142"}], "block_device_mapping_v2": [{"uuid": "96d818e9-d760-4544-940c-bc881d91b404", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b1a0050c-ff5d-4596-bb88-875e50e53328"}]}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:38:32.968468 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.network.neutron [None req-9800fb17-2f78-467a-9a51-ae003ff63606 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] validate_networks() for [('b1a0050c-ff5d-4596-bb88-875e50e53328', None, None, None, None, None)] {{(pid=118314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:38:33.342814 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-9800fb17-2f78-467a-9a51-ae003ff63606 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Flavor limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:38:33.343263 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-9800fb17-2f78-467a-9a51-ae003ff63606 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Image limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:38:33.344401 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-9800fb17-2f78-467a-9a51-ae003ff63606 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Flavor pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:38:33.344821 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-9800fb17-2f78-467a-9a51-ae003ff63606 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Image pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:38:33.345232 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-9800fb17-2f78-467a-9a51-ae003ff63606 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:38:33.353877 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9800fb17-2f78-467a-9a51-ae003ff63606 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:33.354357 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9800fb17-2f78-467a-9a51-ae003ff63606 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:33.354824 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9800fb17-2f78-467a-9a51-ae003ff63606 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:33.355545 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9800fb17-2f78-467a-9a51-ae003ff63606 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:33.355997 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9800fb17-2f78-467a-9a51-ae003ff63606 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:33.356417 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-9800fb17-2f78-467a-9a51-ae003ff63606 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:33.373471 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-9800fb17-2f78-467a-9a51-ae003ff63606 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Getting quotas for project 13bae50787744ee98e555d0db03e7c0e. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:38:33.377632 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-9800fb17-2f78-467a-9a51-ae003ff63606 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Getting quotas for user ac1260c6ff5943f4b4e86ea91f232452 and project 13bae50787744ee98e555d0db03e7c0e. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:38:33.434850 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-9800fb17-2f78-467a-9a51-ae003ff63606 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Going to run 1 instances... {{(pid=118314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:38:33.436907 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-9800fb17-2f78-467a-9a51-ae003ff63606 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='96d818e9-d760-4544-940c-bc881d91b404',volume_size=None,volume_type=None)] {{(pid=118314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:38:33.870452 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-9800fb17-2f78-467a-9a51-ae003ff63606 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.025341 Aug 09 18:38:33.871469 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 589/1202] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Aug 9 18:38:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:38:33.882859 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f371aac9-5cca-40f8-91dc-8935ee96a380 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:33.883573 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f371aac9-5cca-40f8-91dc-8935ee96a380 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:33.936753 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f371aac9-5cca-40f8-91dc-8935ee96a380 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:33.944233 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f371aac9-5cca-40f8-91dc-8935ee96a380 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c" status: 200 len: 1094 microversion: 2.1 time: 0.065384 Aug 09 18:38:33.944806 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 614/1203] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:33 2022] GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:38:34.966220 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-78ed5503-64db-41f5-a4da-6b17c73ea4c5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:34.966854 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-78ed5503-64db-41f5-a4da-6b17c73ea4c5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:34.973635 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-78ed5503-64db-41f5-a4da-6b17c73ea4c5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:34.974123 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-78ed5503-64db-41f5-a4da-6b17c73ea4c5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:34.974558 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-78ed5503-64db-41f5-a4da-6b17c73ea4c5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:34.975279 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-78ed5503-64db-41f5-a4da-6b17c73ea4c5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:34.975732 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-78ed5503-64db-41f5-a4da-6b17c73ea4c5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:34.976156 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-78ed5503-64db-41f5-a4da-6b17c73ea4c5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:35.042427 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-78ed5503-64db-41f5-a4da-6b17c73ea4c5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:35.050182 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-78ed5503-64db-41f5-a4da-6b17c73ea4c5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c" status: 200 len: 1144 microversion: 2.1 time: 0.088305 Aug 09 18:38:35.052657 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 590/1204] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:34 2022] GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:38:36.071695 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-632b6a10-2f14-49c9-ba5b-b836c6231647 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:36.072305 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-632b6a10-2f14-49c9-ba5b-b836c6231647 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:36.079995 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-632b6a10-2f14-49c9-ba5b-b836c6231647 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:36.080239 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-632b6a10-2f14-49c9-ba5b-b836c6231647 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:36.080679 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-632b6a10-2f14-49c9-ba5b-b836c6231647 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:36.081485 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-632b6a10-2f14-49c9-ba5b-b836c6231647 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:36.081947 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-632b6a10-2f14-49c9-ba5b-b836c6231647 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:36.082375 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-632b6a10-2f14-49c9-ba5b-b836c6231647 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:36.176350 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-632b6a10-2f14-49c9-ba5b-b836c6231647 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:36.183865 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-632b6a10-2f14-49c9-ba5b-b836c6231647 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c" status: 200 len: 1210 microversion: 2.1 time: 0.116405 Aug 09 18:38:36.184506 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 615/1205] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:36 2022] GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c => generated 1210 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:38:37.205910 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-2ccfcb4f-3b88-48e0-b9d8-3de9919a5667 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:37.206514 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-2ccfcb4f-3b88-48e0-b9d8-3de9919a5667 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:37.213003 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2ccfcb4f-3b88-48e0-b9d8-3de9919a5667 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:37.213481 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2ccfcb4f-3b88-48e0-b9d8-3de9919a5667 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:37.213912 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2ccfcb4f-3b88-48e0-b9d8-3de9919a5667 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:37.214602 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2ccfcb4f-3b88-48e0-b9d8-3de9919a5667 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:37.215151 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2ccfcb4f-3b88-48e0-b9d8-3de9919a5667 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:37.215571 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-2ccfcb4f-3b88-48e0-b9d8-3de9919a5667 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:37.408695 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-2ccfcb4f-3b88-48e0-b9d8-3de9919a5667 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:37.416138 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-2ccfcb4f-3b88-48e0-b9d8-3de9919a5667 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c" status: 200 len: 1266 microversion: 2.1 time: 0.214638 Aug 09 18:38:37.416694 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 591/1206] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:37 2022] GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:38:37.662390 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-4b99e346-000e-4d39-9511-0be02fe6e614 req-a155c6bc-3256-4b05-b751-87bd70d90592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8429ef6e-e8d3-40e0-bb07-27140c981b8c", "tag": "e365f7c3-80b4-480d-8d42-5d357a25e8c4"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:38:37.672200 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-4b99e346-000e-4d39-9511-0be02fe6e614 req-a155c6bc-3256-4b05-b751-87bd70d90592 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:37.672679 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-4b99e346-000e-4d39-9511-0be02fe6e614 req-a155c6bc-3256-4b05-b751-87bd70d90592 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:37.673110 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-4b99e346-000e-4d39-9511-0be02fe6e614 req-a155c6bc-3256-4b05-b751-87bd70d90592 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:37.683805 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-4b99e346-000e-4d39-9511-0be02fe6e614 req-a155c6bc-3256-4b05-b751-87bd70d90592 service nova] Creating event network-changed:e365f7c3-80b4-480d-8d42-5d357a25e8c4 for instance 8429ef6e-e8d3-40e0-bb07-27140c981b8c on hv-cinder-79797 Aug 09 18:38:37.689189 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-4b99e346-000e-4d39-9511-0be02fe6e614 req-a155c6bc-3256-4b05-b751-87bd70d90592 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030679 Aug 09 18:38:37.695672 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 616/1207] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:38:38.436815 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-8ca1ba32-9007-4e6b-8172-93fabbc0cffb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:38.437627 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-8ca1ba32-9007-4e6b-8172-93fabbc0cffb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:38.444011 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8ca1ba32-9007-4e6b-8172-93fabbc0cffb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:38.444497 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8ca1ba32-9007-4e6b-8172-93fabbc0cffb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:38.444937 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8ca1ba32-9007-4e6b-8172-93fabbc0cffb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:38.445635 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8ca1ba32-9007-4e6b-8172-93fabbc0cffb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:38.446091 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8ca1ba32-9007-4e6b-8172-93fabbc0cffb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:38.446519 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-8ca1ba32-9007-4e6b-8172-93fabbc0cffb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:38.580000 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-8ca1ba32-9007-4e6b-8172-93fabbc0cffb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:38.587794 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-8ca1ba32-9007-4e6b-8172-93fabbc0cffb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c" status: 200 len: 1266 microversion: 2.1 time: 0.154863 Aug 09 18:38:38.588686 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 592/1208] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:38 2022] GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:38:39.610424 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-4204e3ab-50ec-47d1-9198-44bac6993b70 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:39.611155 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-4204e3ab-50ec-47d1-9198-44bac6993b70 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:39.617255 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4204e3ab-50ec-47d1-9198-44bac6993b70 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:39.617745 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4204e3ab-50ec-47d1-9198-44bac6993b70 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:39.618187 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4204e3ab-50ec-47d1-9198-44bac6993b70 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:39.618917 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4204e3ab-50ec-47d1-9198-44bac6993b70 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:39.619386 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4204e3ab-50ec-47d1-9198-44bac6993b70 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:39.619819 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-4204e3ab-50ec-47d1-9198-44bac6993b70 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:39.752652 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-4204e3ab-50ec-47d1-9198-44bac6993b70 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:39.760076 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-4204e3ab-50ec-47d1-9198-44bac6993b70 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c" status: 200 len: 1266 microversion: 2.1 time: 0.154703 Aug 09 18:38:39.760643 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 617/1209] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:39 2022] GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:38:40.782319 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-fac6504e-a34e-4da7-9974-5d7b880f20c8 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:40.782971 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-fac6504e-a34e-4da7-9974-5d7b880f20c8 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:40.789353 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fac6504e-a34e-4da7-9974-5d7b880f20c8 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:40.789837 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fac6504e-a34e-4da7-9974-5d7b880f20c8 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:40.790271 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fac6504e-a34e-4da7-9974-5d7b880f20c8 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:40.790996 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fac6504e-a34e-4da7-9974-5d7b880f20c8 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:40.791458 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fac6504e-a34e-4da7-9974-5d7b880f20c8 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:40.791889 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fac6504e-a34e-4da7-9974-5d7b880f20c8 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:40.920981 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-fac6504e-a34e-4da7-9974-5d7b880f20c8 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:40.928397 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-fac6504e-a34e-4da7-9974-5d7b880f20c8 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c" status: 200 len: 1266 microversion: 2.1 time: 0.150809 Aug 09 18:38:40.928965 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 593/1210] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:40 2022] GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:38:41.949167 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-b26b6778-7829-4c4b-a4da-5f72f6f9c05c tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:41.949717 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-b26b6778-7829-4c4b-a4da-5f72f6f9c05c tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:41.956181 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b26b6778-7829-4c4b-a4da-5f72f6f9c05c tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:41.956663 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b26b6778-7829-4c4b-a4da-5f72f6f9c05c tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:41.957101 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b26b6778-7829-4c4b-a4da-5f72f6f9c05c tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:41.957786 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b26b6778-7829-4c4b-a4da-5f72f6f9c05c tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:41.958247 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b26b6778-7829-4c4b-a4da-5f72f6f9c05c tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:41.958673 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-b26b6778-7829-4c4b-a4da-5f72f6f9c05c tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:42.091728 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-b26b6778-7829-4c4b-a4da-5f72f6f9c05c tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:42.100328 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-b26b6778-7829-4c4b-a4da-5f72f6f9c05c tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c" status: 200 len: 1266 microversion: 2.1 time: 0.155062 Aug 09 18:38:42.100896 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 618/1211] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:41 2022] GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:38:43.120930 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-05ebfb57-a072-43c6-8f34-5d949f316124 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:43.122201 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-05ebfb57-a072-43c6-8f34-5d949f316124 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:43.129004 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-05ebfb57-a072-43c6-8f34-5d949f316124 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:43.129484 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-05ebfb57-a072-43c6-8f34-5d949f316124 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:43.129915 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-05ebfb57-a072-43c6-8f34-5d949f316124 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:43.130605 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-05ebfb57-a072-43c6-8f34-5d949f316124 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:43.131089 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-05ebfb57-a072-43c6-8f34-5d949f316124 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:43.131513 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-05ebfb57-a072-43c6-8f34-5d949f316124 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:43.261870 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-05ebfb57-a072-43c6-8f34-5d949f316124 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:43.269550 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-05ebfb57-a072-43c6-8f34-5d949f316124 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c" status: 200 len: 1266 microversion: 2.1 time: 0.152554 Aug 09 18:38:43.270093 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 594/1212] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:43 2022] GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:38:44.290361 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-681c8f33-e999-4951-a807-894e132dc036 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:44.291002 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-681c8f33-e999-4951-a807-894e132dc036 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:44.293434 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=2 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:38:44.298991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-681c8f33-e999-4951-a807-894e132dc036 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:44.299475 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-681c8f33-e999-4951-a807-894e132dc036 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:44.299913 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-681c8f33-e999-4951-a807-894e132dc036 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:44.300610 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-681c8f33-e999-4951-a807-894e132dc036 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:44.301075 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-681c8f33-e999-4951-a807-894e132dc036 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:44.301503 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-681c8f33-e999-4951-a807-894e132dc036 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:44.433656 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-681c8f33-e999-4951-a807-894e132dc036 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:44.441219 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-681c8f33-e999-4951-a807-894e132dc036 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c" status: 200 len: 1266 microversion: 2.1 time: 0.154675 Aug 09 18:38:44.441775 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 619/1213] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:44 2022] GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:38:45.461742 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-15500e19-77eb-48a1-9a39-cdb4dec97756 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:45.462283 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-15500e19-77eb-48a1-9a39-cdb4dec97756 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:45.464194 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=2 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:38:45.465040 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=6 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:38:45.470957 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15500e19-77eb-48a1-9a39-cdb4dec97756 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:45.471439 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15500e19-77eb-48a1-9a39-cdb4dec97756 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:45.471872 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15500e19-77eb-48a1-9a39-cdb4dec97756 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:45.472560 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15500e19-77eb-48a1-9a39-cdb4dec97756 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:45.473011 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15500e19-77eb-48a1-9a39-cdb4dec97756 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:45.473432 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-15500e19-77eb-48a1-9a39-cdb4dec97756 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:45.606587 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-15500e19-77eb-48a1-9a39-cdb4dec97756 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:45.614497 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-15500e19-77eb-48a1-9a39-cdb4dec97756 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c" status: 200 len: 1266 microversion: 2.1 time: 0.156949 Aug 09 18:38:45.615105 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 595/1214] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:45 2022] GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:38:46.635726 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e8d15526-fd72-41d0-8716-59e70b213e66 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:46.636332 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e8d15526-fd72-41d0-8716-59e70b213e66 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:46.642904 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e8d15526-fd72-41d0-8716-59e70b213e66 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:46.643385 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e8d15526-fd72-41d0-8716-59e70b213e66 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:46.643817 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e8d15526-fd72-41d0-8716-59e70b213e66 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:46.644498 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e8d15526-fd72-41d0-8716-59e70b213e66 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:46.644949 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e8d15526-fd72-41d0-8716-59e70b213e66 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:46.645369 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e8d15526-fd72-41d0-8716-59e70b213e66 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:46.776382 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e8d15526-fd72-41d0-8716-59e70b213e66 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:46.784745 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e8d15526-fd72-41d0-8716-59e70b213e66 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c" status: 200 len: 1266 microversion: 2.1 time: 0.152812 Aug 09 18:38:46.785506 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 620/1215] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:46 2022] GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:38:47.805356 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-3ee8184c-ed1e-4209-bd7a-be901c72ee5f tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:47.805975 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-3ee8184c-ed1e-4209-bd7a-be901c72ee5f tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:47.812554 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3ee8184c-ed1e-4209-bd7a-be901c72ee5f tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:47.813040 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3ee8184c-ed1e-4209-bd7a-be901c72ee5f tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:47.825488 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3ee8184c-ed1e-4209-bd7a-be901c72ee5f tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:47.825488 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3ee8184c-ed1e-4209-bd7a-be901c72ee5f tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:47.825488 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3ee8184c-ed1e-4209-bd7a-be901c72ee5f tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:47.825488 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-3ee8184c-ed1e-4209-bd7a-be901c72ee5f tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:47.954598 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-3ee8184c-ed1e-4209-bd7a-be901c72ee5f tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:47.962333 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-3ee8184c-ed1e-4209-bd7a-be901c72ee5f tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c" status: 200 len: 1266 microversion: 2.1 time: 0.160815 Aug 09 18:38:47.963188 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 596/1216] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:47 2022] GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:38:48.983692 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-568fc465-9f41-4985-b671-591b7aa9b522 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:48.985632 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-568fc465-9f41-4985-b671-591b7aa9b522 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:48.992028 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-568fc465-9f41-4985-b671-591b7aa9b522 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:48.992502 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-568fc465-9f41-4985-b671-591b7aa9b522 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:48.992931 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-568fc465-9f41-4985-b671-591b7aa9b522 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:48.993603 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-568fc465-9f41-4985-b671-591b7aa9b522 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:48.994048 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-568fc465-9f41-4985-b671-591b7aa9b522 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:48.994466 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-568fc465-9f41-4985-b671-591b7aa9b522 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:49.124623 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-568fc465-9f41-4985-b671-591b7aa9b522 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:49.132297 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-568fc465-9f41-4985-b671-591b7aa9b522 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c" status: 200 len: 1266 microversion: 2.1 time: 0.152683 Aug 09 18:38:49.132857 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 621/1217] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:48 2022] GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:38:49.876706 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-733d02a2-af46-46d0-82ec-c18ecce4979b req-571ec2b5-edf3-4b66-8cf2-b721c0ab26de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8429ef6e-e8d3-40e0-bb07-27140c981b8c", "name": "network-vif-plugged", "status": "completed", "tag": "e365f7c3-80b4-480d-8d42-5d357a25e8c4"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:38:49.887216 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-733d02a2-af46-46d0-82ec-c18ecce4979b req-571ec2b5-edf3-4b66-8cf2-b721c0ab26de service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:49.887706 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-733d02a2-af46-46d0-82ec-c18ecce4979b req-571ec2b5-edf3-4b66-8cf2-b721c0ab26de service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:49.888127 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-733d02a2-af46-46d0-82ec-c18ecce4979b req-571ec2b5-edf3-4b66-8cf2-b721c0ab26de service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:49.902252 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-733d02a2-af46-46d0-82ec-c18ecce4979b req-571ec2b5-edf3-4b66-8cf2-b721c0ab26de service nova] Creating event network-vif-plugged:e365f7c3-80b4-480d-8d42-5d357a25e8c4 for instance 8429ef6e-e8d3-40e0-bb07-27140c981b8c on hv-cinder-79797 Aug 09 18:38:49.907224 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-733d02a2-af46-46d0-82ec-c18ecce4979b req-571ec2b5-edf3-4b66-8cf2-b721c0ab26de service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034919 Aug 09 18:38:49.907820 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 597/1218] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:38:50.153661 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-5944a725-9bc0-4023-86cf-8b9354c09d20 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:50.154233 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-5944a725-9bc0-4023-86cf-8b9354c09d20 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:50.160981 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5944a725-9bc0-4023-86cf-8b9354c09d20 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:50.161475 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5944a725-9bc0-4023-86cf-8b9354c09d20 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:50.161913 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5944a725-9bc0-4023-86cf-8b9354c09d20 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:50.162599 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5944a725-9bc0-4023-86cf-8b9354c09d20 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:50.163081 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5944a725-9bc0-4023-86cf-8b9354c09d20 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:50.163509 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-5944a725-9bc0-4023-86cf-8b9354c09d20 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:50.355861 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-5944a725-9bc0-4023-86cf-8b9354c09d20 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:50.364426 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-5944a725-9bc0-4023-86cf-8b9354c09d20 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c" status: 200 len: 1266 microversion: 2.1 time: 0.214755 Aug 09 18:38:50.364992 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 622/1219] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:50 2022] GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:38:51.385902 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-891d80bf-ada1-4662-9a7c-f811afdd8607 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:51.386584 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-891d80bf-ada1-4662-9a7c-f811afdd8607 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:51.393541 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-891d80bf-ada1-4662-9a7c-f811afdd8607 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:51.394066 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-891d80bf-ada1-4662-9a7c-f811afdd8607 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:51.394502 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-891d80bf-ada1-4662-9a7c-f811afdd8607 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:51.395216 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-891d80bf-ada1-4662-9a7c-f811afdd8607 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:51.395682 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-891d80bf-ada1-4662-9a7c-f811afdd8607 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:51.396081 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-891d80bf-ada1-4662-9a7c-f811afdd8607 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:51.534176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-891d80bf-ada1-4662-9a7c-f811afdd8607 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:51.541692 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-891d80bf-ada1-4662-9a7c-f811afdd8607 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c" status: 200 len: 1266 microversion: 2.1 time: 0.160426 Aug 09 18:38:51.542261 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 598/1220] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:51 2022] GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:38:52.562358 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-d24a5bf3-45dc-487e-a55f-8c6092e320b2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:52.562998 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-d24a5bf3-45dc-487e-a55f-8c6092e320b2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:52.569644 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d24a5bf3-45dc-487e-a55f-8c6092e320b2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:52.570129 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d24a5bf3-45dc-487e-a55f-8c6092e320b2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:52.570567 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d24a5bf3-45dc-487e-a55f-8c6092e320b2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:52.571292 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d24a5bf3-45dc-487e-a55f-8c6092e320b2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:52.571750 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d24a5bf3-45dc-487e-a55f-8c6092e320b2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:52.572176 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-d24a5bf3-45dc-487e-a55f-8c6092e320b2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:52.703073 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-d24a5bf3-45dc-487e-a55f-8c6092e320b2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:52.711011 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-d24a5bf3-45dc-487e-a55f-8c6092e320b2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c" status: 200 len: 1454 microversion: 2.1 time: 0.152441 Aug 09 18:38:52.711558 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 623/1221] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:52 2022] GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:38:52.731322 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-373b597c-d5fc-40e3-bb99-a8180592e6ff tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:52.731851 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-373b597c-d5fc-40e3-bb99-a8180592e6ff tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:52.738805 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-373b597c-d5fc-40e3-bb99-a8180592e6ff tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:52.739286 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-373b597c-d5fc-40e3-bb99-a8180592e6ff tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:52.739718 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-373b597c-d5fc-40e3-bb99-a8180592e6ff tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:52.740399 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-373b597c-d5fc-40e3-bb99-a8180592e6ff tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:52.740853 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-373b597c-d5fc-40e3-bb99-a8180592e6ff tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:52.741273 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-373b597c-d5fc-40e3-bb99-a8180592e6ff tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:52.872185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-373b597c-d5fc-40e3-bb99-a8180592e6ff tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:52.879654 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-373b597c-d5fc-40e3-bb99-a8180592e6ff tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c" status: 200 len: 1454 microversion: 2.1 time: 0.152179 Aug 09 18:38:52.880282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 599/1222] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:52 2022] GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:38:54.734637 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-3fd4d78f-22c6-48ba-9879-243f884b35bf req-027fceea-c65c-412f-b6c5-6f6f7a16283f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8429ef6e-e8d3-40e0-bb07-27140c981b8c", "tag": "e365f7c3-80b4-480d-8d42-5d357a25e8c4"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:38:54.745447 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-3fd4d78f-22c6-48ba-9879-243f884b35bf req-027fceea-c65c-412f-b6c5-6f6f7a16283f service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:54.745933 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-3fd4d78f-22c6-48ba-9879-243f884b35bf req-027fceea-c65c-412f-b6c5-6f6f7a16283f service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:54.746361 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-3fd4d78f-22c6-48ba-9879-243f884b35bf req-027fceea-c65c-412f-b6c5-6f6f7a16283f service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:54.758264 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-3fd4d78f-22c6-48ba-9879-243f884b35bf req-027fceea-c65c-412f-b6c5-6f6f7a16283f service nova] Creating event network-changed:e365f7c3-80b4-480d-8d42-5d357a25e8c4 for instance 8429ef6e-e8d3-40e0-bb07-27140c981b8c on hv-cinder-79797 Aug 09 18:38:54.763515 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-3fd4d78f-22c6-48ba-9879-243f884b35bf req-027fceea-c65c-412f-b6c5-6f6f7a16283f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032485 Aug 09 18:38:54.764480 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 624/1223] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:38:57.626602 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:38:57.627371 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Tue Aug 9 18:38:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:39:17.475750 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:39:17.476311 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Tue Aug 9 18:39:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:40:36.617602 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:40:36.618153 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Tue Aug 9 18:40:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:40:51.451078 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:40:51.451720 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Tue Aug 9 18:40:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:40:58.387232 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:40:58.387984 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=78 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:40:58.391811 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-0a2cce3e-4510-4faa-9794-5db60ffd75a9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-4330099", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1200008127", "security_groups": [{"name": "tempest-secgroup-smoke-1192013142"}], "block_device_mapping_v2": [{"uuid": "1d685e2b-5baa-49ed-a3d0-236f04b549d6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b1a0050c-ff5d-4596-bb88-875e50e53328"}]}} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:40:58.553331 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.network.neutron [None req-0a2cce3e-4510-4faa-9794-5db60ffd75a9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] validate_networks() for [('b1a0050c-ff5d-4596-bb88-875e50e53328', None, None, None, None, None)] {{(pid=118314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:40:58.963907 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-0a2cce3e-4510-4faa-9794-5db60ffd75a9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Flavor limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:40:58.964364 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-0a2cce3e-4510-4faa-9794-5db60ffd75a9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Image limits 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:40:58.964837 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-0a2cce3e-4510-4faa-9794-5db60ffd75a9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Flavor pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:40:58.965282 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-0a2cce3e-4510-4faa-9794-5db60ffd75a9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Image pref 0:0:0 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:40:58.965695 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.virt.hardware [None req-0a2cce3e-4510-4faa-9794-5db60ffd75a9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:40:58.974383 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0a2cce3e-4510-4faa-9794-5db60ffd75a9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:40:58.974383 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0a2cce3e-4510-4faa-9794-5db60ffd75a9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:40:58.974383 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0a2cce3e-4510-4faa-9794-5db60ffd75a9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:40:58.974383 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0a2cce3e-4510-4faa-9794-5db60ffd75a9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:40:58.979640 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0a2cce3e-4510-4faa-9794-5db60ffd75a9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:40:58.979640 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0a2cce3e-4510-4faa-9794-5db60ffd75a9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:40:58.994549 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-0a2cce3e-4510-4faa-9794-5db60ffd75a9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Getting quotas for project 13bae50787744ee98e555d0db03e7c0e. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:40:58.998491 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.quota [None req-0a2cce3e-4510-4faa-9794-5db60ffd75a9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Getting quotas for user ac1260c6ff5943f4b4e86ea91f232452 and project 13bae50787744ee98e555d0db03e7c0e. Resources: {'cores', 'instances', 'ram'} {{(pid=118314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:40:59.055766 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-0a2cce3e-4510-4faa-9794-5db60ffd75a9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Going to run 1 instances... {{(pid=118314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:40:59.057879 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-0a2cce3e-4510-4faa-9794-5db60ffd75a9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1d685e2b-5baa-49ed-a3d0-236f04b549d6',volume_size=None,volume_type=None)] {{(pid=118314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:40:59.477762 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-0a2cce3e-4510-4faa-9794-5db60ffd75a9 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.092207 Aug 09 18:40:59.487505 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 600/1224] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Aug 9 18:40:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:40:59.487675 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1d47593f-9627-4025-92f3-721383b3ec19] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 18:40:59.488165 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:40:59.489040 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:40:59.493549 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-f77b01aa-5da0-46c1-b176-e6f07b6fb6a5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:40:59.494375 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-f77b01aa-5da0-46c1-b176-e6f07b6fb6a5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:40:59.600151 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-f77b01aa-5da0-46c1-b176-e6f07b6fb6a5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:40:59.607434 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-f77b01aa-5da0-46c1-b176-e6f07b6fb6a5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb" status: 200 len: 1092 microversion: 2.1 time: 0.121800 Aug 09 18:40:59.607991 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 625/1225] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:40:59 2022] GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb => generated 1092 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:00.628549 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c8f82402-5fb4-4b5a-bccd-340b0def478a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:00.629176 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c8f82402-5fb4-4b5a-bccd-340b0def478a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:00.635780 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c8f82402-5fb4-4b5a-bccd-340b0def478a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:00.636263 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c8f82402-5fb4-4b5a-bccd-340b0def478a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:00.636700 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c8f82402-5fb4-4b5a-bccd-340b0def478a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:00.637390 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c8f82402-5fb4-4b5a-bccd-340b0def478a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:00.637844 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c8f82402-5fb4-4b5a-bccd-340b0def478a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:00.638269 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c8f82402-5fb4-4b5a-bccd-340b0def478a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:00.698726 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c8f82402-5fb4-4b5a-bccd-340b0def478a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:00.706463 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c8f82402-5fb4-4b5a-bccd-340b0def478a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb" status: 200 len: 1134 microversion: 2.1 time: 0.082561 Aug 09 18:41:00.707047 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 601/1226] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:00 2022] GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb => generated 1134 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:01.736652 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-96d7f906-71f5-4a73-afa8-efc0ea45ebcb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:01.737216 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-96d7f906-71f5-4a73-afa8-efc0ea45ebcb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:01.752398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO oslo.messaging._drivers.impl_rabbit [-] [1d47593f-9627-4025-92f3-721383b3ec19] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 35640. Aug 09 18:41:01.755426 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-96d7f906-71f5-4a73-afa8-efc0ea45ebcb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:01.762504 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-96d7f906-71f5-4a73-afa8-efc0ea45ebcb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:01.762504 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-96d7f906-71f5-4a73-afa8-efc0ea45ebcb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:01.762504 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-96d7f906-71f5-4a73-afa8-efc0ea45ebcb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:01.762504 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-96d7f906-71f5-4a73-afa8-efc0ea45ebcb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:01.762972 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-96d7f906-71f5-4a73-afa8-efc0ea45ebcb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:01.830025 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-96d7f906-71f5-4a73-afa8-efc0ea45ebcb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:01.838110 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-96d7f906-71f5-4a73-afa8-efc0ea45ebcb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb" status: 200 len: 1208 microversion: 2.1 time: 0.105594 Aug 09 18:41:01.838644 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 626/1227] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:01 2022] GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb => generated 1208 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:02.859099 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-1985c5dc-bf26-4859-8ae0-58caae30b42a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:02.859099 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-1985c5dc-bf26-4859-8ae0-58caae30b42a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:02.867661 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1985c5dc-bf26-4859-8ae0-58caae30b42a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:02.870430 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1985c5dc-bf26-4859-8ae0-58caae30b42a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:02.870430 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1985c5dc-bf26-4859-8ae0-58caae30b42a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:02.870430 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1985c5dc-bf26-4859-8ae0-58caae30b42a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:02.870430 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1985c5dc-bf26-4859-8ae0-58caae30b42a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:02.871425 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-1985c5dc-bf26-4859-8ae0-58caae30b42a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:03.030576 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-1985c5dc-bf26-4859-8ae0-58caae30b42a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:03.038205 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-1985c5dc-bf26-4859-8ae0-58caae30b42a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb" status: 200 len: 1276 microversion: 2.1 time: 0.183558 Aug 09 18:41:03.038789 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 602/1228] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:02 2022] GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb => generated 1276 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:03.075113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-dd990b2a-69e4-4e53-bb41-e78e0cadacfd req-f3a38682-e3cb-4f65-a3a4-a94b896b8c75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a7c2283-db76-41d1-9c2d-6c86993b0fcb", "tag": "e2166667-0cae-4c9a-a4fd-b07e1b1fca1a"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:41:03.090114 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-dd990b2a-69e4-4e53-bb41-e78e0cadacfd req-f3a38682-e3cb-4f65-a3a4-a94b896b8c75 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:03.090595 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-dd990b2a-69e4-4e53-bb41-e78e0cadacfd req-f3a38682-e3cb-4f65-a3a4-a94b896b8c75 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:03.091055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-dd990b2a-69e4-4e53-bb41-e78e0cadacfd req-f3a38682-e3cb-4f65-a3a4-a94b896b8c75 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:03.104113 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-dd990b2a-69e4-4e53-bb41-e78e0cadacfd req-f3a38682-e3cb-4f65-a3a4-a94b896b8c75 service nova] Creating event network-changed:e2166667-0cae-4c9a-a4fd-b07e1b1fca1a for instance 9a7c2283-db76-41d1-9c2d-6c86993b0fcb on hv-cinder-79797 Aug 09 18:41:03.109061 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-dd990b2a-69e4-4e53-bb41-e78e0cadacfd req-f3a38682-e3cb-4f65-a3a4-a94b896b8c75 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037657 Aug 09 18:41:03.109678 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 627/1229] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:41:04.059387 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-75984b06-417e-4799-8e38-c8acf19298f5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:04.060007 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-75984b06-417e-4799-8e38-c8acf19298f5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:04.066115 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-75984b06-417e-4799-8e38-c8acf19298f5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:04.069017 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-75984b06-417e-4799-8e38-c8acf19298f5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:04.069017 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-75984b06-417e-4799-8e38-c8acf19298f5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:04.069017 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-75984b06-417e-4799-8e38-c8acf19298f5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:04.069017 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-75984b06-417e-4799-8e38-c8acf19298f5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:04.069544 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-75984b06-417e-4799-8e38-c8acf19298f5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:04.206898 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-75984b06-417e-4799-8e38-c8acf19298f5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:04.214633 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-75984b06-417e-4799-8e38-c8acf19298f5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb" status: 200 len: 1264 microversion: 2.1 time: 0.159264 Aug 09 18:41:04.215218 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 603/1230] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:04 2022] GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:05.240928 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-c89e7ec5-a632-47cc-9557-d7deac3d25e5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:05.241612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-c89e7ec5-a632-47cc-9557-d7deac3d25e5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:05.247767 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c89e7ec5-a632-47cc-9557-d7deac3d25e5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:05.248323 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c89e7ec5-a632-47cc-9557-d7deac3d25e5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:05.248771 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c89e7ec5-a632-47cc-9557-d7deac3d25e5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:05.249476 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c89e7ec5-a632-47cc-9557-d7deac3d25e5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:05.249933 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c89e7ec5-a632-47cc-9557-d7deac3d25e5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:05.250357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-c89e7ec5-a632-47cc-9557-d7deac3d25e5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:05.380782 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-c89e7ec5-a632-47cc-9557-d7deac3d25e5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:05.388232 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-c89e7ec5-a632-47cc-9557-d7deac3d25e5 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb" status: 200 len: 1264 microversion: 2.1 time: 0.152797 Aug 09 18:41:05.388802 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 628/1231] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:05 2022] GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:06.409429 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-992e9297-82b3-44ed-93ef-7cb9abf4e9d2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:06.409994 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-992e9297-82b3-44ed-93ef-7cb9abf4e9d2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:06.416474 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-992e9297-82b3-44ed-93ef-7cb9abf4e9d2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:06.416962 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-992e9297-82b3-44ed-93ef-7cb9abf4e9d2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:06.417398 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-992e9297-82b3-44ed-93ef-7cb9abf4e9d2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:06.418083 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-992e9297-82b3-44ed-93ef-7cb9abf4e9d2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:06.418540 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-992e9297-82b3-44ed-93ef-7cb9abf4e9d2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:06.419008 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-992e9297-82b3-44ed-93ef-7cb9abf4e9d2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:06.552271 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-992e9297-82b3-44ed-93ef-7cb9abf4e9d2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:06.560827 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-992e9297-82b3-44ed-93ef-7cb9abf4e9d2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb" status: 200 len: 1264 microversion: 2.1 time: 0.155339 Aug 09 18:41:06.561385 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 604/1232] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:06 2022] GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:07.581706 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-46fdc306-4fe9-4f19-838e-66b213693bd2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:07.582350 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-46fdc306-4fe9-4f19-838e-66b213693bd2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:07.589357 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-46fdc306-4fe9-4f19-838e-66b213693bd2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:07.589841 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-46fdc306-4fe9-4f19-838e-66b213693bd2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:07.590277 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-46fdc306-4fe9-4f19-838e-66b213693bd2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:07.590994 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-46fdc306-4fe9-4f19-838e-66b213693bd2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:07.591459 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-46fdc306-4fe9-4f19-838e-66b213693bd2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:07.591912 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-46fdc306-4fe9-4f19-838e-66b213693bd2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:07.724959 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-46fdc306-4fe9-4f19-838e-66b213693bd2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:07.732366 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-46fdc306-4fe9-4f19-838e-66b213693bd2 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb" status: 200 len: 1264 microversion: 2.1 time: 0.154828 Aug 09 18:41:07.732929 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 629/1233] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:07 2022] GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:08.753730 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f39128c2-cd77-4218-a783-3c033f3b53eb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:08.754344 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f39128c2-cd77-4218-a783-3c033f3b53eb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:08.761053 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f39128c2-cd77-4218-a783-3c033f3b53eb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:08.761531 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f39128c2-cd77-4218-a783-3c033f3b53eb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:08.761966 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f39128c2-cd77-4218-a783-3c033f3b53eb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:08.762651 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f39128c2-cd77-4218-a783-3c033f3b53eb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:08.763202 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f39128c2-cd77-4218-a783-3c033f3b53eb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:08.763622 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f39128c2-cd77-4218-a783-3c033f3b53eb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:08.892958 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f39128c2-cd77-4218-a783-3c033f3b53eb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:08.900383 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f39128c2-cd77-4218-a783-3c033f3b53eb tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb" status: 200 len: 1264 microversion: 2.1 time: 0.150503 Aug 09 18:41:08.900942 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 605/1234] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:08 2022] GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:09.921398 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-eb1db0ee-3bc9-434c-9f06-5b5821f5aacc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:09.922002 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-eb1db0ee-3bc9-434c-9f06-5b5821f5aacc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:09.924443 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell0:SELECT=2 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:41:09.930192 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eb1db0ee-3bc9-434c-9f06-5b5821f5aacc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:09.936770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eb1db0ee-3bc9-434c-9f06-5b5821f5aacc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:09.936770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eb1db0ee-3bc9-434c-9f06-5b5821f5aacc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:09.936770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eb1db0ee-3bc9-434c-9f06-5b5821f5aacc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:09.936770 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eb1db0ee-3bc9-434c-9f06-5b5821f5aacc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:09.937201 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-eb1db0ee-3bc9-434c-9f06-5b5821f5aacc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:10.068619 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-eb1db0ee-3bc9-434c-9f06-5b5821f5aacc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:10.076226 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-eb1db0ee-3bc9-434c-9f06-5b5821f5aacc tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb" status: 200 len: 1264 microversion: 2.1 time: 0.158617 Aug 09 18:41:10.076795 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 630/1235] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:09 2022] GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:11.097233 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-f8beabb3-ffe6-4c45-8db4-5ddcfeb306be tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:11.097837 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-f8beabb3-ffe6-4c45-8db4-5ddcfeb306be tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:11.099732 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=2 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:41:11.101188 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell0:SELECT=6 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:41:11.106459 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f8beabb3-ffe6-4c45-8db4-5ddcfeb306be tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:11.106974 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f8beabb3-ffe6-4c45-8db4-5ddcfeb306be tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:11.107411 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f8beabb3-ffe6-4c45-8db4-5ddcfeb306be tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:11.108146 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f8beabb3-ffe6-4c45-8db4-5ddcfeb306be tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:11.108601 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f8beabb3-ffe6-4c45-8db4-5ddcfeb306be tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:11.109022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-f8beabb3-ffe6-4c45-8db4-5ddcfeb306be tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:11.239585 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-f8beabb3-ffe6-4c45-8db4-5ddcfeb306be tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:11.247783 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-f8beabb3-ffe6-4c45-8db4-5ddcfeb306be tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb" status: 200 len: 1264 microversion: 2.1 time: 0.154366 Aug 09 18:41:11.248339 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 606/1236] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:11 2022] GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:12.268321 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-154c6af1-4ece-46aa-9766-63aeb388dead tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:12.268935 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-154c6af1-4ece-46aa-9766-63aeb388dead tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:12.275787 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-154c6af1-4ece-46aa-9766-63aeb388dead tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:12.276271 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-154c6af1-4ece-46aa-9766-63aeb388dead tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:12.276755 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-154c6af1-4ece-46aa-9766-63aeb388dead tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:12.277449 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-154c6af1-4ece-46aa-9766-63aeb388dead tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:12.277902 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-154c6af1-4ece-46aa-9766-63aeb388dead tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:12.278326 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-154c6af1-4ece-46aa-9766-63aeb388dead tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:12.411656 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-154c6af1-4ece-46aa-9766-63aeb388dead tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:12.420069 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-154c6af1-4ece-46aa-9766-63aeb388dead tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb" status: 200 len: 1264 microversion: 2.1 time: 0.155543 Aug 09 18:41:12.420858 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 631/1237] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:12 2022] GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:13.441172 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-dc25a10e-3a6c-4b46-8a0e-f91e63b7d0db tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:13.441786 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-dc25a10e-3a6c-4b46-8a0e-f91e63b7d0db tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:13.448211 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc25a10e-3a6c-4b46-8a0e-f91e63b7d0db tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:13.448693 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc25a10e-3a6c-4b46-8a0e-f91e63b7d0db tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:13.449125 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc25a10e-3a6c-4b46-8a0e-f91e63b7d0db tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:13.449807 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc25a10e-3a6c-4b46-8a0e-f91e63b7d0db tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:13.450257 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc25a10e-3a6c-4b46-8a0e-f91e63b7d0db tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:13.450677 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-dc25a10e-3a6c-4b46-8a0e-f91e63b7d0db tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:13.579603 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-dc25a10e-3a6c-4b46-8a0e-f91e63b7d0db tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:13.587782 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-dc25a10e-3a6c-4b46-8a0e-f91e63b7d0db tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb" status: 200 len: 1264 microversion: 2.1 time: 0.150440 Aug 09 18:41:13.588342 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 607/1238] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:13 2022] GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:14.524500 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [req-2255d4d0-322a-4ab5-8717-db5e36d21e6f req-38a5ecf2-fc4a-4a95-99c7-7510a33a9a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a7c2283-db76-41d1-9c2d-6c86993b0fcb", "name": "network-vif-plugged", "status": "completed", "tag": "e2166667-0cae-4c9a-a4fd-b07e1b1fca1a"}]} {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:41:14.534140 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-2255d4d0-322a-4ab5-8717-db5e36d21e6f req-38a5ecf2-fc4a-4a95-99c7-7510a33a9a5e service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:14.534629 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-2255d4d0-322a-4ab5-8717-db5e36d21e6f req-38a5ecf2-fc4a-4a95-99c7-7510a33a9a5e service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:14.535084 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [req-2255d4d0-322a-4ab5-8717-db5e36d21e6f req-38a5ecf2-fc4a-4a95-99c7-7510a33a9a5e service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:14.545841 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.compute.server_external_events [req-2255d4d0-322a-4ab5-8717-db5e36d21e6f req-38a5ecf2-fc4a-4a95-99c7-7510a33a9a5e service nova] Creating event network-vif-plugged:e2166667-0cae-4c9a-a4fd-b07e1b1fca1a for instance 9a7c2283-db76-41d1-9c2d-6c86993b0fcb on hv-cinder-79797 Aug 09 18:41:14.552223 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [req-2255d4d0-322a-4ab5-8717-db5e36d21e6f req-38a5ecf2-fc4a-4a95-99c7-7510a33a9a5e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087600 Aug 09 18:41:14.554057 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 632/1239] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:41:14.608734 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-49e3a072-1b47-48cb-aee1-80660e8e6658 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:14.609289 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-49e3a072-1b47-48cb-aee1-80660e8e6658 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:14.615710 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-49e3a072-1b47-48cb-aee1-80660e8e6658 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:14.616697 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-49e3a072-1b47-48cb-aee1-80660e8e6658 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:14.617237 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-49e3a072-1b47-48cb-aee1-80660e8e6658 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:14.617934 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-49e3a072-1b47-48cb-aee1-80660e8e6658 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:14.618394 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-49e3a072-1b47-48cb-aee1-80660e8e6658 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:14.618850 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-49e3a072-1b47-48cb-aee1-80660e8e6658 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:14.755194 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-49e3a072-1b47-48cb-aee1-80660e8e6658 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:14.763555 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-49e3a072-1b47-48cb-aee1-80660e8e6658 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb" status: 200 len: 1264 microversion: 2.1 time: 0.158855 Aug 09 18:41:14.764150 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 608/1240] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:14 2022] GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:15.784251 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e4f06e0e-6a29-4d9b-91ee-4f622cca202a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:15.784943 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e4f06e0e-6a29-4d9b-91ee-4f622cca202a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:15.791594 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e4f06e0e-6a29-4d9b-91ee-4f622cca202a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:15.792078 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e4f06e0e-6a29-4d9b-91ee-4f622cca202a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:15.792510 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e4f06e0e-6a29-4d9b-91ee-4f622cca202a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:15.793194 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e4f06e0e-6a29-4d9b-91ee-4f622cca202a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:15.793646 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e4f06e0e-6a29-4d9b-91ee-4f622cca202a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:15.794065 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e4f06e0e-6a29-4d9b-91ee-4f622cca202a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:15.922626 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-e4f06e0e-6a29-4d9b-91ee-4f622cca202a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:15.930809 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e4f06e0e-6a29-4d9b-91ee-4f622cca202a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb" status: 200 len: 1264 microversion: 2.1 time: 0.150710 Aug 09 18:41:15.931376 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 633/1241] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:15 2022] GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:16.951146 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-fe31387b-dc4a-46a1-a285-332b897594cf tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:16.951827 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-fe31387b-dc4a-46a1-a285-332b897594cf tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:16.958384 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fe31387b-dc4a-46a1-a285-332b897594cf tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:16.958898 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fe31387b-dc4a-46a1-a285-332b897594cf tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:16.959355 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fe31387b-dc4a-46a1-a285-332b897594cf tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:16.960160 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fe31387b-dc4a-46a1-a285-332b897594cf tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:16.960614 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fe31387b-dc4a-46a1-a285-332b897594cf tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:16.961050 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fe31387b-dc4a-46a1-a285-332b897594cf tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:17.093864 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-fe31387b-dc4a-46a1-a285-332b897594cf tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:17.101998 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-fe31387b-dc4a-46a1-a285-332b897594cf tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb" status: 200 len: 1451 microversion: 2.1 time: 0.154679 Aug 09 18:41:17.102612 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 609/1242] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:16 2022] GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:17.122362 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-60ca8b2a-74e5-4a7e-8cc9-217f4aeb235a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:17.123002 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-60ca8b2a-74e5-4a7e-8cc9-217f4aeb235a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:17.129411 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-60ca8b2a-74e5-4a7e-8cc9-217f4aeb235a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:17.129896 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-60ca8b2a-74e5-4a7e-8cc9-217f4aeb235a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:17.130334 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-60ca8b2a-74e5-4a7e-8cc9-217f4aeb235a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:17.131050 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-60ca8b2a-74e5-4a7e-8cc9-217f4aeb235a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:17.131531 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-60ca8b2a-74e5-4a7e-8cc9-217f4aeb235a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:17.131956 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-60ca8b2a-74e5-4a7e-8cc9-217f4aeb235a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:17.262008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-60ca8b2a-74e5-4a7e-8cc9-217f4aeb235a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:17.269351 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-60ca8b2a-74e5-4a7e-8cc9-217f4aeb235a tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb" status: 200 len: 1451 microversion: 2.1 time: 0.150898 Aug 09 18:41:17.269910 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 634/1243] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:17 2022] GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:19.445535 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-a87e06e9-668c-446a-b50a-d4da020c3ac6 req-10bdfbc7-51a4-4ef1-bbe7-6729f3863382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a7c2283-db76-41d1-9c2d-6c86993b0fcb", "tag": "e2166667-0cae-4c9a-a4fd-b07e1b1fca1a"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:41:19.458286 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-a87e06e9-668c-446a-b50a-d4da020c3ac6 req-10bdfbc7-51a4-4ef1-bbe7-6729f3863382 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:19.458286 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-a87e06e9-668c-446a-b50a-d4da020c3ac6 req-10bdfbc7-51a4-4ef1-bbe7-6729f3863382 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:19.458286 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-a87e06e9-668c-446a-b50a-d4da020c3ac6 req-10bdfbc7-51a4-4ef1-bbe7-6729f3863382 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:19.471940 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-a87e06e9-668c-446a-b50a-d4da020c3ac6 req-10bdfbc7-51a4-4ef1-bbe7-6729f3863382 service nova] Creating event network-changed:e2166667-0cae-4c9a-a4fd-b07e1b1fca1a for instance 9a7c2283-db76-41d1-9c2d-6c86993b0fcb on hv-cinder-79797 Aug 09 18:41:19.478278 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-a87e06e9-668c-446a-b50a-d4da020c3ac6 req-10bdfbc7-51a4-4ef1-bbe7-6729f3863382 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037225 Aug 09 18:41:19.478907 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 610/1244] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:42:17.636439 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:42:17.637011 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Tue Aug 9 18:42:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:42:37.483510 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:42:37.484081 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Tue Aug 9 18:42:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:43:19.331334 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-75b919cc-5e58-43f8-895d-037afb51e6b3 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:19.332441 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR oslo.messaging._drivers.impl_rabbit [-] [42b217cc-ff29-433a-b80f-cb3775aa45c0] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 09 18:43:19.332950 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-75b919cc-5e58-43f8-895d-037afb51e6b3 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:19.333077 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:43:19.333773 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG dbcounter [-] [118314] Writing DB stats nova_cell1:SELECT=58 {{(pid=118314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:43:19.335549 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_api:SELECT=22 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:43:19.336202 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG dbcounter [-] [118313] Writing DB stats nova_cell1:SELECT=46 {{(pid=118313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:43:19.338765 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-693f15c6-580b-4b0c-9fc7-a56656438e7f req-52c71141-fc15-4f75-8787-007ce07ebae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a7c2283-db76-41d1-9c2d-6c86993b0fcb", "tag": "e2166667-0cae-4c9a-a4fd-b07e1b1fca1a"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:43:19.341878 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-75b919cc-5e58-43f8-895d-037afb51e6b3 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:19.342182 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-75b919cc-5e58-43f8-895d-037afb51e6b3 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:19.342895 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-75b919cc-5e58-43f8-895d-037afb51e6b3 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:19.343595 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-75b919cc-5e58-43f8-895d-037afb51e6b3 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:19.344045 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-75b919cc-5e58-43f8-895d-037afb51e6b3 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:19.344471 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-75b919cc-5e58-43f8-895d-037afb51e6b3 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:19.348347 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-693f15c6-580b-4b0c-9fc7-a56656438e7f req-52c71141-fc15-4f75-8787-007ce07ebae4 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:19.355124 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-693f15c6-580b-4b0c-9fc7-a56656438e7f req-52c71141-fc15-4f75-8787-007ce07ebae4 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:19.355124 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-693f15c6-580b-4b0c-9fc7-a56656438e7f req-52c71141-fc15-4f75-8787-007ce07ebae4 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:19.361837 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-693f15c6-580b-4b0c-9fc7-a56656438e7f req-52c71141-fc15-4f75-8787-007ce07ebae4 service nova] Creating event network-changed:e2166667-0cae-4c9a-a4fd-b07e1b1fca1a for instance 9a7c2283-db76-41d1-9c2d-6c86993b0fcb on hv-cinder-79797 Aug 09 18:43:19.367281 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-693f15c6-580b-4b0c-9fc7-a56656438e7f req-52c71141-fc15-4f75-8787-007ce07ebae4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037203 Aug 09 18:43:19.368094 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 611/1245] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:43:19.371596 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-75b919cc-5e58-43f8-895d-037afb51e6b3 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] Going to try to terminate instance {{(pid=118313) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:43:19.715612 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-75b919cc-5e58-43f8-895d-037afb51e6b3 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb" status: 204 len: 0 microversion: 2.1 time: 0.388433 Aug 09 18:43:19.719483 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 635/1246] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:43:19 2022] DELETE /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:43:19.725481 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-0fdf7f7e-a5f3-4639-84c1-ad0fc1821b24 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:19.728090 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-0fdf7f7e-a5f3-4639-84c1-ad0fc1821b24 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:19.736343 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0fdf7f7e-a5f3-4639-84c1-ad0fc1821b24 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:19.736903 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0fdf7f7e-a5f3-4639-84c1-ad0fc1821b24 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:19.737271 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0fdf7f7e-a5f3-4639-84c1-ad0fc1821b24 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:19.737999 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0fdf7f7e-a5f3-4639-84c1-ad0fc1821b24 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:19.738455 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0fdf7f7e-a5f3-4639-84c1-ad0fc1821b24 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:19.738938 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-0fdf7f7e-a5f3-4639-84c1-ad0fc1821b24 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:19.891820 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-0fdf7f7e-a5f3-4639-84c1-ad0fc1821b24 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:43:19.899437 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-0fdf7f7e-a5f3-4639-84c1-ad0fc1821b24 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb" status: 200 len: 1575 microversion: 2.1 time: 0.178479 Aug 09 18:43:19.900014 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 612/1247] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:19 2022] GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:43:20.921949 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-72a38096-354a-4fd2-b9b6-46e9a8e8dea6 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:20.922641 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-72a38096-354a-4fd2-b9b6-46e9a8e8dea6 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:20.929691 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-72a38096-354a-4fd2-b9b6-46e9a8e8dea6 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:20.930186 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-72a38096-354a-4fd2-b9b6-46e9a8e8dea6 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:20.930646 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-72a38096-354a-4fd2-b9b6-46e9a8e8dea6 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:20.931381 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-72a38096-354a-4fd2-b9b6-46e9a8e8dea6 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:20.932697 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-72a38096-354a-4fd2-b9b6-46e9a8e8dea6 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:20.933209 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-72a38096-354a-4fd2-b9b6-46e9a8e8dea6 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:21.065283 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-72a38096-354a-4fd2-b9b6-46e9a8e8dea6 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:43:21.072827 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-72a38096-354a-4fd2-b9b6-46e9a8e8dea6 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb" status: 200 len: 1457 microversion: 2.1 time: 0.155169 Aug 09 18:43:21.073392 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 636/1248] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:20 2022] GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb => generated 1457 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:43:21.880056 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-552f6ce1-973b-4750-8acc-1e2f62061a56 req-c4025fe0-f689-4031-afdf-e2d34cff7823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a7c2283-db76-41d1-9c2d-6c86993b0fcb", "name": "network-vif-deleted", "tag": "e2166667-0cae-4c9a-a4fd-b07e1b1fca1a"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:43:21.890824 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-552f6ce1-973b-4750-8acc-1e2f62061a56 req-c4025fe0-f689-4031-afdf-e2d34cff7823 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:21.891407 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-552f6ce1-973b-4750-8acc-1e2f62061a56 req-c4025fe0-f689-4031-afdf-e2d34cff7823 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:21.891829 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-552f6ce1-973b-4750-8acc-1e2f62061a56 req-c4025fe0-f689-4031-afdf-e2d34cff7823 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:21.903912 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-552f6ce1-973b-4750-8acc-1e2f62061a56 req-c4025fe0-f689-4031-afdf-e2d34cff7823 service nova] Creating event network-vif-deleted:e2166667-0cae-4c9a-a4fd-b07e1b1fca1a for instance 9a7c2283-db76-41d1-9c2d-6c86993b0fcb on hv-cinder-79797 Aug 09 18:43:21.907431 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO oslo.messaging._drivers.impl_rabbit [-] [42b217cc-ff29-433a-b80f-cb3775aa45c0] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 35730. Aug 09 18:43:21.909061 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-552f6ce1-973b-4750-8acc-1e2f62061a56 req-c4025fe0-f689-4031-afdf-e2d34cff7823 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033113 Aug 09 18:43:21.909694 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 613/1249] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:43:22.094188 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-25d260fa-00f5-4f8a-97b9-9f850172443e tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:22.094742 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-25d260fa-00f5-4f8a-97b9-9f850172443e tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:22.101063 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-25d260fa-00f5-4f8a-97b9-9f850172443e tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:22.101548 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-25d260fa-00f5-4f8a-97b9-9f850172443e tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:22.101982 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-25d260fa-00f5-4f8a-97b9-9f850172443e tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:22.102669 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-25d260fa-00f5-4f8a-97b9-9f850172443e tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:22.103154 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-25d260fa-00f5-4f8a-97b9-9f850172443e tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:22.104282 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-25d260fa-00f5-4f8a-97b9-9f850172443e tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:22.168000 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-25d260fa-00f5-4f8a-97b9-9f850172443e tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:43:22.176053 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-25d260fa-00f5-4f8a-97b9-9f850172443e tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb" status: 200 len: 1223 microversion: 2.1 time: 0.085766 Aug 09 18:43:22.176637 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 637/1250] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:22 2022] GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:43:23.196789 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-21afa0f9-1b7b-4d32-bf3d-a94cd1a24d8c tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:23.198068 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-21afa0f9-1b7b-4d32-bf3d-a94cd1a24d8c tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 9a7c2283-db76-41d1-9c2d-6c86993b0fcb] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:23.204761 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-21afa0f9-1b7b-4d32-bf3d-a94cd1a24d8c tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:23.205235 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-21afa0f9-1b7b-4d32-bf3d-a94cd1a24d8c tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:23.205659 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-21afa0f9-1b7b-4d32-bf3d-a94cd1a24d8c tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:23.206335 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-21afa0f9-1b7b-4d32-bf3d-a94cd1a24d8c tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:23.206811 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-21afa0f9-1b7b-4d32-bf3d-a94cd1a24d8c tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:23.207229 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-21afa0f9-1b7b-4d32-bf3d-a94cd1a24d8c tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:23.220931 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-21afa0f9-1b7b-4d32-bf3d-a94cd1a24d8c tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] HTTP exception thrown: Instance 9a7c2283-db76-41d1-9c2d-6c86993b0fcb could not be found. Aug 09 18:43:23.222465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-21afa0f9-1b7b-4d32-bf3d-a94cd1a24d8c tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Request method failure captured: Aug 09 18:43:23.222465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb HTTP/1.1 Aug 09 18:43:23.222465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:43:23.222465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:43:23.222465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:43:23.222465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 0 Aug 09 18:43:23.222465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:43:23.222465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:43:23.222465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:43:23.222465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:43:23.222465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qjpVf2G6OSFd2VDo-TBiVPtNxpDTeDPD_pxAeW4XKslDy0TsUsdGNi3opVFcwG8_nlQ_MV73l8DflSeZFyKx7itf9f-QBTMRmzT0EqL6MkAI28RudwwrzEXgjbvshP1pJa8SEiXzaEZi6-30vBSWJzH-6RYFhgIzGVq20wdVhFS8HA Aug 09 18:43:23.222465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:43:23.222465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:43:23.222465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:43:23.222465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:43:23.222465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:43:23.222465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:43:23.222465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: 13bae50787744ee98e555d0db03e7c0e Aug 09 18:43:23.222465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-TestVolumeBootPattern-912954134 Aug 09 18:43:23.222465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:43:23.222465 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:43:23.224371 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13bae50787744ee98e555d0db03e7c0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/13bae50787744ee98e555d0db03e7c0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_13bae50787744ee98e555d0db03e7c0e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13bae50787744ee98e555d0db03e7c0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:43:23.224371 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-TestVolumeBootPattern-912954134 Aug 09 18:43:23.224371 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: 13bae50787744ee98e555d0db03e7c0e Aug 09 18:43:23.224371 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-TestVolumeBootPattern-912954134 Aug 09 18:43:23.224371 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-TestVolumeBootPattern-912954134-project Aug 09 18:43:23.224371 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:43:23.224371 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:43:23.224371 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: ac1260c6ff5943f4b4e86ea91f232452 Aug 09 18:43:23.224371 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-TestVolumeBootPattern-912954134-project Aug 09 18:43:23.224371 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: > Aug 09 18:43:23.224371 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Instance 9a7c2283-db76-41d1-9c2d-6c86993b0fcb could not be found. Aug 09 18:43:23.224371 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'id': '9a7c2283-db76-41d1-9c2d-6c86993b0fcb'} Aug 09 18:43:23.225298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:43:23.225298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:43:23.225298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:43:23.225298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:43:23.225298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:43:23.225298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:43:23.225298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:43:23.225298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:43:23.225298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:43:23.225298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:43:23.225298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a7c2283-db76-41d1-9c2d-6c86993b0fcb could not be found. Aug 09 18:43:23.225298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:43:23.225298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:43:23.225298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:43:23.225298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:43:23.225298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:43:23.225298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:43:23.225298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:43:23.225298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:43:23.225298 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:43:23.227022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:43:23.227022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:43:23.227022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:43:23.227022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:43:23.227022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:43:23.227022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:43:23.227022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:43:23.227022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a7c2283-db76-41d1-9c2d-6c86993b0fcb could not be found. Aug 09 18:43:23.227022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:43:23.227022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:43:23.227022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:43:23.227022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:43:23.227022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:43:23.227022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:43:23.227022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:43:23.227022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:43:23.227022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a7c2283-db76-41d1-9c2d-6c86993b0fcb could not be found. Aug 09 18:43:23.227022 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:43:23.228790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-21afa0f9-1b7b-4d32-bf3d-a94cd1a24d8c tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Returning 404 to user: Instance 9a7c2283-db76-41d1-9c2d-6c86993b0fcb could not be found. {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:43:23.228790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-21afa0f9-1b7b-4d32-bf3d-a94cd1a24d8c tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb" status: 404 len: 111 microversion: 2.1 time: 0.031268 Aug 09 18:43:23.228790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 614/1251] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:23 2022] GET /compute/v2.1/servers/9a7c2283-db76-41d1-9c2d-6c86993b0fcb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:43:26.800107 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-e1d74766-ea81-4212-8a66-6f10cd898aba tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:26.805305 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-43c49bdb-3b33-43e6-a7a2-6849dd5bd275 req-3316ef19-8aec-472e-8a7b-4cedce4d98fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8429ef6e-e8d3-40e0-bb07-27140c981b8c", "tag": "e365f7c3-80b4-480d-8d42-5d357a25e8c4"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:43:26.807055 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e1d74766-ea81-4212-8a66-6f10cd898aba tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:26.813873 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e1d74766-ea81-4212-8a66-6f10cd898aba tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:26.814368 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e1d74766-ea81-4212-8a66-6f10cd898aba tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:26.814831 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e1d74766-ea81-4212-8a66-6f10cd898aba tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:26.815532 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e1d74766-ea81-4212-8a66-6f10cd898aba tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:26.815984 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e1d74766-ea81-4212-8a66-6f10cd898aba tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:26.816931 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-e1d74766-ea81-4212-8a66-6f10cd898aba tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:26.820720 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-43c49bdb-3b33-43e6-a7a2-6849dd5bd275 req-3316ef19-8aec-472e-8a7b-4cedce4d98fc service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:26.821193 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-43c49bdb-3b33-43e6-a7a2-6849dd5bd275 req-3316ef19-8aec-472e-8a7b-4cedce4d98fc service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:26.821617 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-43c49bdb-3b33-43e6-a7a2-6849dd5bd275 req-3316ef19-8aec-472e-8a7b-4cedce4d98fc service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:26.834018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-43c49bdb-3b33-43e6-a7a2-6849dd5bd275 req-3316ef19-8aec-472e-8a7b-4cedce4d98fc service nova] Creating event network-changed:e365f7c3-80b4-480d-8d42-5d357a25e8c4 for instance 8429ef6e-e8d3-40e0-bb07-27140c981b8c on hv-cinder-79797 Aug 09 18:43:26.840032 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-43c49bdb-3b33-43e6-a7a2-6849dd5bd275 req-3316ef19-8aec-472e-8a7b-4cedce4d98fc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038222 Aug 09 18:43:26.841185 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 615/1252] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:43:26.846840 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-e1d74766-ea81-4212-8a66-6f10cd898aba tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Going to try to terminate instance {{(pid=118313) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:43:27.154798 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-e1d74766-ea81-4212-8a66-6f10cd898aba tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c" status: 204 len: 0 microversion: 2.1 time: 0.358411 Aug 09 18:43:27.155395 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 638/1253] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:43:26 2022] DELETE /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:43:27.164902 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c0155828-9cc2-4a29-9e06-7c155c2deda7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:27.166478 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c0155828-9cc2-4a29-9e06-7c155c2deda7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:27.173242 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c0155828-9cc2-4a29-9e06-7c155c2deda7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:27.173869 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c0155828-9cc2-4a29-9e06-7c155c2deda7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:27.174553 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c0155828-9cc2-4a29-9e06-7c155c2deda7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:27.175523 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c0155828-9cc2-4a29-9e06-7c155c2deda7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:27.176223 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c0155828-9cc2-4a29-9e06-7c155c2deda7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:27.176704 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c0155828-9cc2-4a29-9e06-7c155c2deda7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:27.351120 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.policy [None req-c0155828-9cc2-4a29-9e06-7c155c2deda7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:43:27.360430 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c0155828-9cc2-4a29-9e06-7c155c2deda7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c" status: 200 len: 1579 microversion: 2.1 time: 0.200113 Aug 09 18:43:27.361015 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 616/1254] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:27 2022] GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c => generated 1579 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:43:28.383016 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-12de19a3-985c-43b3-a3c2-890a65244ee8 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:28.383752 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-12de19a3-985c-43b3-a3c2-890a65244ee8 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:28.390596 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-12de19a3-985c-43b3-a3c2-890a65244ee8 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:28.391136 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-12de19a3-985c-43b3-a3c2-890a65244ee8 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:28.391549 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-12de19a3-985c-43b3-a3c2-890a65244ee8 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:28.392243 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-12de19a3-985c-43b3-a3c2-890a65244ee8 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:28.392709 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-12de19a3-985c-43b3-a3c2-890a65244ee8 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:28.393134 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-12de19a3-985c-43b3-a3c2-890a65244ee8 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:28.531872 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-12de19a3-985c-43b3-a3c2-890a65244ee8 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:43:28.539281 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-12de19a3-985c-43b3-a3c2-890a65244ee8 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c" status: 200 len: 1460 microversion: 2.1 time: 0.160529 Aug 09 18:43:28.539850 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 639/1255] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:28 2022] GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c => generated 1460 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:43:29.328515 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [req-2419b5ea-0aaa-425f-b8a2-1dcbbf88b022 req-96e2826e-c6dc-4055-a057-6dfa6e3755d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8429ef6e-e8d3-40e0-bb07-27140c981b8c", "name": "network-vif-deleted", "tag": "e365f7c3-80b4-480d-8d42-5d357a25e8c4"}]} {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:43:29.339374 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-2419b5ea-0aaa-425f-b8a2-1dcbbf88b022 req-96e2826e-c6dc-4055-a057-6dfa6e3755d1 service nova] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:29.339847 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-2419b5ea-0aaa-425f-b8a2-1dcbbf88b022 req-96e2826e-c6dc-4055-a057-6dfa6e3755d1 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:29.340297 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [req-2419b5ea-0aaa-425f-b8a2-1dcbbf88b022 req-96e2826e-c6dc-4055-a057-6dfa6e3755d1 service nova] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:29.351034 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.compute.server_external_events [req-2419b5ea-0aaa-425f-b8a2-1dcbbf88b022 req-96e2826e-c6dc-4055-a057-6dfa6e3755d1 service nova] Creating event network-vif-deleted:e365f7c3-80b4-480d-8d42-5d357a25e8c4 for instance 8429ef6e-e8d3-40e0-bb07-27140c981b8c on hv-cinder-79797 Aug 09 18:43:29.356224 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [req-2419b5ea-0aaa-425f-b8a2-1dcbbf88b022 req-96e2826e-c6dc-4055-a057-6dfa6e3755d1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031709 Aug 09 18:43:29.356845 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 617/1256] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Aug 9 18:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:43:29.561499 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-10a9f700-f03e-4af5-8c35-8ab1e8c75f28 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:29.562075 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-10a9f700-f03e-4af5-8c35-8ab1e8c75f28 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:29.568501 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-10a9f700-f03e-4af5-8c35-8ab1e8c75f28 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:29.569000 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-10a9f700-f03e-4af5-8c35-8ab1e8c75f28 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:29.569430 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-10a9f700-f03e-4af5-8c35-8ab1e8c75f28 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:29.570120 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-10a9f700-f03e-4af5-8c35-8ab1e8c75f28 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:29.570574 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-10a9f700-f03e-4af5-8c35-8ab1e8c75f28 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:29.571014 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-10a9f700-f03e-4af5-8c35-8ab1e8c75f28 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:29.640100 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.policy [None req-10a9f700-f03e-4af5-8c35-8ab1e8c75f28 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1260c6ff5943f4b4e86ea91f232452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bae50787744ee98e555d0db03e7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:43:29.648189 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-10a9f700-f03e-4af5-8c35-8ab1e8c75f28 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c" status: 200 len: 1225 microversion: 2.1 time: 0.090654 Aug 09 18:43:29.648887 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 640/1257] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:29 2022] GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:43:30.672487 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c50d9385-caa6-4bd1-a48b-ebde83df2818 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:30.673191 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-c50d9385-caa6-4bd1-a48b-ebde83df2818 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 8429ef6e-e8d3-40e0-bb07-27140c981b8c] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:30.679328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c50d9385-caa6-4bd1-a48b-ebde83df2818 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:30.679817 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c50d9385-caa6-4bd1-a48b-ebde83df2818 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:30.680255 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c50d9385-caa6-4bd1-a48b-ebde83df2818 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:30.681001 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c50d9385-caa6-4bd1-a48b-ebde83df2818 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:30.681595 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c50d9385-caa6-4bd1-a48b-ebde83df2818 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:30.682075 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-c50d9385-caa6-4bd1-a48b-ebde83df2818 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:30.695199 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-c50d9385-caa6-4bd1-a48b-ebde83df2818 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] HTTP exception thrown: Instance 8429ef6e-e8d3-40e0-bb07-27140c981b8c could not be found. Aug 09 18:43:30.697328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c50d9385-caa6-4bd1-a48b-ebde83df2818 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Request method failure captured: Aug 09 18:43:30.697328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c HTTP/1.1 Aug 09 18:43:30.697328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:43:30.697328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:43:30.697328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:43:30.697328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 0 Aug 09 18:43:30.697328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:43:30.697328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:43:30.697328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:43:30.697328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:43:30.697328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qjpVf2G6OSFd2VDo-TBiVPtNxpDTeDPD_pxAeW4XKslDy0TsUsdGNi3opVFcwG8_nlQ_MV73l8DflSeZFyKx7itf9f-QBTMRmzT0EqL6MkAI28RudwwrzEXgjbvshP1pJa8SEiXzaEZi6-30vBSWJzH-6RYFhgIzGVq20wdVhFS8HA Aug 09 18:43:30.697328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:43:30.697328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:43:30.697328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:43:30.697328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:43:30.697328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:43:30.697328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:43:30.697328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: 13bae50787744ee98e555d0db03e7c0e Aug 09 18:43:30.697328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-TestVolumeBootPattern-912954134 Aug 09 18:43:30.697328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:43:30.697328 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:43:30.699258 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13bae50787744ee98e555d0db03e7c0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/13bae50787744ee98e555d0db03e7c0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_13bae50787744ee98e555d0db03e7c0e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13bae50787744ee98e555d0db03e7c0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:43:30.699258 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-TestVolumeBootPattern-912954134 Aug 09 18:43:30.699258 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: 13bae50787744ee98e555d0db03e7c0e Aug 09 18:43:30.699258 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-TestVolumeBootPattern-912954134 Aug 09 18:43:30.699258 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-TestVolumeBootPattern-912954134-project Aug 09 18:43:30.699258 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:43:30.699258 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:43:30.699258 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: ac1260c6ff5943f4b4e86ea91f232452 Aug 09 18:43:30.699258 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-TestVolumeBootPattern-912954134-project Aug 09 18:43:30.699258 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: > Aug 09 18:43:30.699258 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Instance 8429ef6e-e8d3-40e0-bb07-27140c981b8c could not be found. Aug 09 18:43:30.699258 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'id': '8429ef6e-e8d3-40e0-bb07-27140c981b8c'} Aug 09 18:43:30.700474 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:43:30.700474 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:43:30.700474 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:43:30.700474 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:43:30.700474 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:43:30.700474 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:43:30.700474 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:43:30.700474 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:43:30.700474 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:43:30.700474 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:43:30.700474 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8429ef6e-e8d3-40e0-bb07-27140c981b8c could not be found. Aug 09 18:43:30.700474 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:43:30.700474 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:43:30.700474 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:43:30.700474 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:43:30.700474 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:43:30.700474 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:43:30.700474 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:43:30.700474 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:43:30.700474 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:43:30.701832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:43:30.701832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:43:30.701832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:43:30.701832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:43:30.701832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:43:30.701832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:43:30.701832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:43:30.701832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8429ef6e-e8d3-40e0-bb07-27140c981b8c could not be found. Aug 09 18:43:30.701832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:43:30.701832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:43:30.701832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:43:30.701832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:43:30.701832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:43:30.701832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:43:30.701832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:43:30.701832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:43:30.701832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8429ef6e-e8d3-40e0-bb07-27140c981b8c could not be found. Aug 09 18:43:30.701832 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:43:30.703130 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-c50d9385-caa6-4bd1-a48b-ebde83df2818 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Returning 404 to user: Instance 8429ef6e-e8d3-40e0-bb07-27140c981b8c could not be found. {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:43:30.703130 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-c50d9385-caa6-4bd1-a48b-ebde83df2818 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c" status: 404 len: 111 microversion: 2.1 time: 0.030925 Aug 09 18:43:30.703130 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 618/1258] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:30 2022] GET /compute/v2.1/servers/8429ef6e-e8d3-40e0-bb07-27140c981b8c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:43:31.224337 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-92463b2a-4fda-4fb3-abd2-fdffa4f71be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:31.224870 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.compute.api [None req-92463b2a-4fda-4fb3-abd2-fdffa4f71be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:31.232897 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-92463b2a-4fda-4fb3-abd2-fdffa4f71be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:31.233687 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-92463b2a-4fda-4fb3-abd2-fdffa4f71be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:31.234397 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-92463b2a-4fda-4fb3-abd2-fdffa4f71be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:31.235588 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-92463b2a-4fda-4fb3-abd2-fdffa4f71be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:31.236354 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-92463b2a-4fda-4fb3-abd2-fdffa4f71be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:31.237116 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG oslo_concurrency.lockutils [None req-92463b2a-4fda-4fb3-abd2-fdffa4f71be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:31.253237 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.wsgi [None req-92463b2a-4fda-4fb3-abd2-fdffa4f71be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] HTTP exception thrown: Instance 7fd2e961-f88f-40b8-be45-f7b189058554 could not be found. Aug 09 18:43:31.255008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-92463b2a-4fda-4fb3-abd2-fdffa4f71be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Request method failure captured: Aug 09 18:43:31.255008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: request: DELETE /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 HTTP/1.1 Aug 09 18:43:31.255008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept: application/json Aug 09 18:43:31.255008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Accept-Encoding: identity Aug 09 18:43:31.255008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Connection: close Aug 09 18:43:31.255008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Length: 0 Aug 09 18:43:31.255008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Content-Type: application/json Aug 09 18:43:31.255008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Host: 10.222.0.36 Aug 09 18:43:31.255008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Openstack-System-Scope: None Aug 09 18:43:31.255008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: User-Agent: python-urllib3/1.26.11 Aug 09 18:43:31.255008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Auth-Token: gAAAAABi8qjpVf2G6OSFd2VDo-TBiVPtNxpDTeDPD_pxAeW4XKslDy0TsUsdGNi3opVFcwG8_nlQ_MV73l8DflSeZFyKx7itf9f-QBTMRmzT0EqL6MkAI28RudwwrzEXgjbvshP1pJa8SEiXzaEZi6-30vBSWJzH-6RYFhgIzGVq20wdVhFS8HA Aug 09 18:43:31.255008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Id: None Aug 09 18:43:31.255008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Domain-Name: None Aug 09 18:43:31.255008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Identity-Status: Confirmed Aug 09 18:43:31.255008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Is-Admin-Project: True Aug 09 18:43:31.255008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Id: default Aug 09 18:43:31.255008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Domain-Name: Default Aug 09 18:43:31.255008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Id: 13bae50787744ee98e555d0db03e7c0e Aug 09 18:43:31.255008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Project-Name: tempest-TestVolumeBootPattern-912954134 Aug 09 18:43:31.255008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Role: reader,member Aug 09 18:43:31.255008 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Roles: reader,member Aug 09 18:43:31.256792 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13bae50787744ee98e555d0db03e7c0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/13bae50787744ee98e555d0db03e7c0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_13bae50787744ee98e555d0db03e7c0e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13bae50787744ee98e555d0db03e7c0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:43:31.256792 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant: tempest-TestVolumeBootPattern-912954134 Aug 09 18:43:31.256792 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Id: 13bae50787744ee98e555d0db03e7c0e Aug 09 18:43:31.256792 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-Tenant-Name: tempest-TestVolumeBootPattern-912954134 Aug 09 18:43:31.256792 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User: tempest-TestVolumeBootPattern-912954134-project Aug 09 18:43:31.256792 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Id: default Aug 09 18:43:31.256792 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Domain-Name: Default Aug 09 18:43:31.256792 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Id: ac1260c6ff5943f4b4e86ea91f232452 Aug 09 18:43:31.256792 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: X-User-Name: tempest-TestVolumeBootPattern-912954134-project Aug 09 18:43:31.256792 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: method: > Aug 09 18:43:31.256792 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: exception: Instance 7fd2e961-f88f-40b8-be45-f7b189058554 could not be found. Aug 09 18:43:31.256792 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: action_args: {'id': '7fd2e961-f88f-40b8-be45-f7b189058554'} Aug 09 18:43:31.257808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:43:31.257808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:43:31.257808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:43:31.257808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:43:31.257808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:43:31.257808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:43:31.257808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:43:31.257808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:43:31.257808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:43:31.257808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:43:31.257808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fd2e961-f88f-40b8-be45-f7b189058554 could not be found. Aug 09 18:43:31.257808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:43:31.257808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:43:31.257808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:43:31.257808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:43:31.257808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:43:31.257808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:43:31.257808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:43:31.257808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:43:31.257808 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:43:31.260301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:43:31.260301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:43:31.260301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:43:31.260301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:43:31.260301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:43:31.260301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:43:31.260301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:43:31.260301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:43:31.260301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:43:31.260301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fd2e961-f88f-40b8-be45-f7b189058554 could not be found. Aug 09 18:43:31.260301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:43:31.260301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:43:31.260301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:43:31.260301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:43:31.260301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:43:31.260301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:43:31.260301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:43:31.260301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:43:31.260301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fd2e961-f88f-40b8-be45-f7b189058554 could not be found. Aug 09 18:43:31.260301 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: ERROR nova.api.openstack.wsgi Aug 09 18:43:31.262299 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-92463b2a-4fda-4fb3-abd2-fdffa4f71be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Returning 404 to user: Instance 7fd2e961-f88f-40b8-be45-f7b189058554 could not be found. {{(pid=118313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:43:31.262299 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-92463b2a-4fda-4fb3-abd2-fdffa4f71be7 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 404 len: 111 microversion: 2.1 time: 0.036694 Aug 09 18:43:31.262299 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 641/1259] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Aug 9 18:43:31 2022] DELETE /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:43:31.269248 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-fc91e544-856f-4160-9106-74eafb4cff64 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '>' {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:31.270325 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.compute.api [None req-fc91e544-856f-4160-9106-74eafb4cff64 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] [instance: 7fd2e961-f88f-40b8-be45-f7b189058554] Fetching instance by UUID {{(pid=118314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:31.279721 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fc91e544-856f-4160-9106-74eafb4cff64 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:31.280533 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fc91e544-856f-4160-9106-74eafb4cff64 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:31.281276 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fc91e544-856f-4160-9106-74eafb4cff64 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:31.282473 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fc91e544-856f-4160-9106-74eafb4cff64 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Acquiring lock "87906804-98dc-4bc9-abd9-60a13ec853ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:31.283311 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fc91e544-856f-4160-9106-74eafb4cff64 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:31.284035 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG oslo_concurrency.lockutils [None req-fc91e544-856f-4160-9106-74eafb4cff64 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Lock "87906804-98dc-4bc9-abd9-60a13ec853ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:31.299470 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.wsgi [None req-fc91e544-856f-4160-9106-74eafb4cff64 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] HTTP exception thrown: Instance 7fd2e961-f88f-40b8-be45-f7b189058554 could not be found. Aug 09 18:43:31.301010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-fc91e544-856f-4160-9106-74eafb4cff64 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Request method failure captured: Aug 09 18:43:31.301010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: request: GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 HTTP/1.1 Aug 09 18:43:31.301010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept: application/json Aug 09 18:43:31.301010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Accept-Encoding: identity Aug 09 18:43:31.301010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Connection: close Aug 09 18:43:31.301010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Length: 0 Aug 09 18:43:31.301010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Content-Type: application/json Aug 09 18:43:31.301010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Host: 10.222.0.36 Aug 09 18:43:31.301010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Openstack-System-Scope: None Aug 09 18:43:31.301010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: User-Agent: python-urllib3/1.26.11 Aug 09 18:43:31.301010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Auth-Token: gAAAAABi8qjpVf2G6OSFd2VDo-TBiVPtNxpDTeDPD_pxAeW4XKslDy0TsUsdGNi3opVFcwG8_nlQ_MV73l8DflSeZFyKx7itf9f-QBTMRmzT0EqL6MkAI28RudwwrzEXgjbvshP1pJa8SEiXzaEZi6-30vBSWJzH-6RYFhgIzGVq20wdVhFS8HA Aug 09 18:43:31.301010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Id: None Aug 09 18:43:31.301010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Domain-Name: None Aug 09 18:43:31.301010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Identity-Status: Confirmed Aug 09 18:43:31.301010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Is-Admin-Project: True Aug 09 18:43:31.301010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Id: default Aug 09 18:43:31.301010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Domain-Name: Default Aug 09 18:43:31.301010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Id: 13bae50787744ee98e555d0db03e7c0e Aug 09 18:43:31.301010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Project-Name: tempest-TestVolumeBootPattern-912954134 Aug 09 18:43:31.301010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Role: reader,member Aug 09 18:43:31.301010 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Roles: reader,member Aug 09 18:43:31.302795 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13bae50787744ee98e555d0db03e7c0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/13bae50787744ee98e555d0db03e7c0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_13bae50787744ee98e555d0db03e7c0e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13bae50787744ee98e555d0db03e7c0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Aug 09 18:43:31.302795 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant: tempest-TestVolumeBootPattern-912954134 Aug 09 18:43:31.302795 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Id: 13bae50787744ee98e555d0db03e7c0e Aug 09 18:43:31.302795 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-Tenant-Name: tempest-TestVolumeBootPattern-912954134 Aug 09 18:43:31.302795 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User: tempest-TestVolumeBootPattern-912954134-project Aug 09 18:43:31.302795 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Id: default Aug 09 18:43:31.302795 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Domain-Name: Default Aug 09 18:43:31.302795 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Id: ac1260c6ff5943f4b4e86ea91f232452 Aug 09 18:43:31.302795 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: X-User-Name: tempest-TestVolumeBootPattern-912954134-project Aug 09 18:43:31.302795 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: method: > Aug 09 18:43:31.302795 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: exception: Instance 7fd2e961-f88f-40b8-be45-f7b189058554 could not be found. Aug 09 18:43:31.302795 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: action_args: {'id': '7fd2e961-f88f-40b8-be45-f7b189058554'} Aug 09 18:43:31.303790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: {{(pid=118314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:43:31.303790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:43:31.303790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:43:31.303790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:43:31.303790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:43:31.303790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:43:31.303790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:43:31.303790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:43:31.303790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:43:31.303790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:43:31.303790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fd2e961-f88f-40b8-be45-f7b189058554 could not be found. Aug 09 18:43:31.303790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:43:31.303790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:43:31.303790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:43:31.303790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:43:31.303790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:43:31.303790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:43:31.303790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:43:31.303790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:43:31.303790 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:43:31.305388 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:43:31.305388 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:43:31.305388 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:43:31.305388 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:43:31.305388 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:43:31.305388 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:43:31.305388 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:43:31.305388 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fd2e961-f88f-40b8-be45-f7b189058554 could not be found. Aug 09 18:43:31.305388 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:43:31.305388 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:43:31.305388 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:43:31.305388 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:43:31.305388 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:43:31.305388 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:43:31.305388 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:43:31.305388 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:43:31.305388 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fd2e961-f88f-40b8-be45-f7b189058554 could not be found. Aug 09 18:43:31.305388 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: ERROR nova.api.openstack.wsgi Aug 09 18:43:31.307715 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: DEBUG nova.api.openstack.wsgi [None req-fc91e544-856f-4160-9106-74eafb4cff64 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Returning 404 to user: Instance 7fd2e961-f88f-40b8-be45-f7b189058554 could not be found. {{(pid=118314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:43:31.307715 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO nova.api.openstack.requestlog [None req-fc91e544-856f-4160-9106-74eafb4cff64 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554" status: 404 len: 111 microversion: 2.1 time: 0.038426 Aug 09 18:43:31.307715 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: [pid: 118314|app: 0|req: 619/1260] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:31 2022] GET /compute/v2.1/servers/7fd2e961-f88f-40b8-be45-f7b189058554 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:43:32.787121 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: DEBUG nova.api.openstack.wsgi [None req-4800bd04-6cba-4e7c-800e-3cfe8de14c01 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] Calling method '.version_select at 0x7f4c39c4aa60>' {{(pid=118313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:32.908756 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO nova.api.openstack.requestlog [None req-4800bd04-6cba-4e7c-800e-3cfe8de14c01 tempest-TestVolumeBootPattern-912954134 tempest-TestVolumeBootPattern-912954134-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1200008127" status: 202 len: 0 microversion: 2.1 time: 0.125452 Aug 09 18:43:32.909359 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: [pid: 118313|app: 0|req: 642/1261] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Aug 9 18:43:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1200008127 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:43:56.627431 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:43:56.628018 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Tue Aug 9 18:43:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:43:59.843243 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:43:59.843900 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Tue Aug 9 18:43:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:45:37.644386 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:45:37.644977 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Tue Aug 9 18:45:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:45:51.461548 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:45:51.478102 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Tue Aug 9 18:45:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:45:53.666300 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:45:53.666871 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Tue Aug 9 18:45:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:45:57.491341 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:45:57.491965 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Tue Aug 9 18:45:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:47:16.635394 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:47:16.635911 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Tue Aug 9 18:47:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:47:19.850974 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:47:19.851724 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Tue Aug 9 18:47:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:48:57.652489 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:48:57.653059 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Tue Aug 9 18:48:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:49:11.470232 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:49:11.470689 dv-cinder-797970-5-iscsi devstack@n-api.service[118314]: Tue Aug 9 18:49:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:49:13.674354 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:49:13.674976 dv-cinder-797970-5-iscsi devstack@n-api.service[118313]: Tue Aug 9 18:49:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!